-- Logs begin at Mon 2022-05-23 17:11:13 UTC, end at Mon 2022-05-23 18:32:32 UTC. -- May 23 17:52:49.616669 dv-cinder-750782-23-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 23 17:52:49.626004 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 17:52:49 2022] *** May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: nodename: dv-cinder-750782-23-iscsi May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: machine: x86_64 May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: clock source: unix May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: pcre jit disabled May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: detected number of CPU cores: 4 May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: current working directory: / May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: detected binary path: /usr/bin/uwsgi-core May 23 17:52:49.628106 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: your processes number limit is 47680 May 23 17:52:49.628741 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: your memory page size is 4096 bytes May 23 17:52:49.628741 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: detected max file descriptor number: 2048 May 23 17:52:49.628741 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: lock engine: pthread robust mutexes May 23 17:52:49.628741 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: thunder lock: enabled May 23 17:52:49.628741 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 23 17:52:49.628741 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 17:52:49.672594 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: Python main interpreter initialized at 0x55c5bf0749c0 May 23 17:52:49.672594 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: python threads support enabled May 23 17:52:49.672594 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: your server socket listen backlog is limited to 100 connections May 23 17:52:49.672594 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: your mercy for graceful operations on workers is 90 seconds May 23 17:52:49.672924 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: mapped 403077 bytes (393 KB) for 2 cores May 23 17:52:49.672998 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: *** Operational MODE: preforking *** May 23 17:52:49.673263 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: *** uWSGI is running in multiple interpreter mode *** May 23 17:52:49.673263 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: spawned uWSGI master process (pid: 80370) May 23 17:52:49.673455 dv-cinder-750782-23-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 23 17:52:49.676909 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: spawned uWSGI worker 1 (pid: 80381, cores: 1) May 23 17:52:49.676909 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: spawned uWSGI worker 2 (pid: 80382, cores: 1) May 23 17:52:49.676909 dv-cinder-750782-23-iscsi devstack@keystone.service[80370]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 17:52:55.335816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:52:55.335816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: from cryptography.utils import int_from_bytes May 23 17:52:55.336586 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:52:55.336586 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: from cryptography.utils import int_from_bytes May 23 17:52:55.385960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 17:52:55.386150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 17:52:55.386337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] command line args: [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 17:52:55.386601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 17:52:55.386801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ================================================================================ {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 17:52:55.387055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] admin_token = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.387307 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] config_dir = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.387491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.387671 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] config_source = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.387849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] debug = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.388047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.388532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.388621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.388874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.389325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.389432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.389567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_config_append = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.389743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.389920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_dir = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.390096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_file = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.390331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.390578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.390849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.391095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.391270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.391444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.391694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.391939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.392172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.392402 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.392632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.392862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.393106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.393350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.393621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.394103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.394288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] publish_errors = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.394519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.394777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.394958 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.395202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.395435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.395667 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] standard_threads = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.395895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.396136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.396311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.396486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] use_journal = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.396660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] use_json = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.396832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] use_stderr = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.397005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] use_syslog = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.397237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.397492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.397727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.397982 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.398216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.398464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.398708 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.398964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.399103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:52:55.399103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: from cryptography.utils import int_from_bytes May 23 17:52:55.399602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.399602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.399740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 17:52:55.399740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: from cryptography.utils import int_from_bytes May 23 17:52:55.399919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.399919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.400115 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.400355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.400586 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.400829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.401072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.401307 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.401556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.401806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.402047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.402277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.402526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.402808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.403059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.403306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.403535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.403765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.403994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.404225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.405073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.405320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.405548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.405776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.406019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.406264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.406500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.406769 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.407003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.407242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.407476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.407704 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.407931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.408160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.408384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.408617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.408860 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.409089 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.409323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.409551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.409784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.410017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.410261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.410488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.410739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.410976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.411211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.411445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.411679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.411905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.412150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.412382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.412617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.412846 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.413102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.413336 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.413564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.413797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.414029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.414294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.414530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.414798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.415042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.415274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.415506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.415738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.415982 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.416217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.416452 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.416691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.416924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.417164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.417397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.417630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.417863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.418119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.418355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.418592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.418850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.419090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.419324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.419558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.419791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.420615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.420845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.421079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.421310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.421537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.421776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.422006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.422250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.422484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.422754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.423014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.423251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.423478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.external = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.423706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.423997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.424225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.424452 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.password = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.424679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] auth.token = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.424915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.425147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.425389 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.425618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.425863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.426107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.426337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.426568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.426833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.427086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.427330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.427566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.427806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.428037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.428287 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.428535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.428766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.429015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.429296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.429538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.429796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.430037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.430289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.430522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.430776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.431022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.431265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.431493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.431735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.431969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.432218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.432450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.432700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.432940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.433183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.433416 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.433661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.433905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.434138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.434367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.434610 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.434863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.435098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.435345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.435624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.435853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.436080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.436296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.436535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.436777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.437023 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.437274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.437517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.437783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.438017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.438252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.438483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.438749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.438962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.439192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.439427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.439662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.439920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.440149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.440392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.440634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.440864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.441107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.441348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.441576 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.441811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.442035 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.442268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.442500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.442761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.442997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.443231 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.443476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.443718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.443944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.444169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.444413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.444655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.444887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.445118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.445349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.445576 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.445811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.446120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.446350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.446664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.447108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.447440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.447674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.447904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.448135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.448367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.448602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.448831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.449074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.449318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.449558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.449664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 17:52:55.449800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.449882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 17:52:55.450041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] command line args: [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 17:52:55.450118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.450266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.450349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 17:52:55.450498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ================================================================================ {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 17:52:55.450573 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.450750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.450833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] admin_token = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.450988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.451067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] config_dir = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.451278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.451363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.451564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] config_source = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.451717 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.451848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] debug = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.451987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.452116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.452273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.452412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.452553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.452680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.452822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.452960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.453096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.453224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.453349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.453473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.453597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.453729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_config_append = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.453855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.453982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.454108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.454236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_dir = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.454236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_file = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.454481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.454617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.454767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.454767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.455012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.455144 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.455279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.455407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.455541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.455541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.455784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.455909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.456043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.456178 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.456305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.456457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.456593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.456722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.456847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.456980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.457106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.457230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.457358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.457483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.457607 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.457741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.457867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.458005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.458132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] role.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.458259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.458393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] role.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.458393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.458393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.458801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.458801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] publish_errors = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.459053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.459183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.459310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.459456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.459582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.459720 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.459855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.459989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.460115 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.460241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.460368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.460497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] standard_threads = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.460633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.460761 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.460887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.461014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.461148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.461273 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.461414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.461542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] use_journal = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.461668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.461796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] use_json = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.461923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.462050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] use_stderr = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.462050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] use_syslog = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.462297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.462423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 17:52:55.462550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.462677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.462829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.462919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.462994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463574 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.463936 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464716 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464926 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.464997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.465073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.465145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.465278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.465360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.465509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.465587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.465755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.465835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.465988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.466067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.466241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.466320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.466486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.466571 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.466737 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.467438 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.467560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.467718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.467806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.468002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.468081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.468256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.468335 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.468493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.468580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.468726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.468806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.468962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.469040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.469206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.469292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.469434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.469513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.469676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.469754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.469910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.469997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.470160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.470239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.connection = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.470411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.470499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.470651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.470744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.470928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.471010 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.471163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.471241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.471394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.471473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.471630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.471719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.471862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.471940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.472093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.472171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.472322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.472401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.472554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.472632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.472790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.472867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.473020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.473100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.473259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.473337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.473491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.473568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.473729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.473808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.473954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.474032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.474189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.474268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.474419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.474499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.474571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 17:52:55.474642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.474912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.475155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.475396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.475637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.475878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.476111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.476364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.476601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.476842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.477076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.477349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.477613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.477869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.478133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.478402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.478712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.479231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.479501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.479764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.480024 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.480306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.480577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.480832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.481080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.481364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.481628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.481891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.482131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.482404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.483246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.483615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.483898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.484152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.484416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.484688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.484929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.485181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.485425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.485691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.485949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.486206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.486468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.486741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.487012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.487266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.487557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.487818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.488118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.488404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.488672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.488909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.external = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.489144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.489444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.489702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.489971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.password = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.490228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] auth.token = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.490492 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.490763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.491019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.491256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.491506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.491781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.492034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.492310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.492582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.492854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.493108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.493351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.493603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.493842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.494130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.494427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.494689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.494989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.495278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.495548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.495832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.496119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.496418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.496680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.496923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.497210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.497482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.497754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.498051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.498490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.498778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.499025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.499288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.499528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.499780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.500018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.500270 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.500521 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.500760 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.500999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.501248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.501482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.501722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.501975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.502231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.502467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.502724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.503007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.503299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.503577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.503829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.504087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.504336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.504632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.504901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.505174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.505429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.505507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.505657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.505738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.505880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.505963 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.506184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.506451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.506742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.507026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.507282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.507556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.507829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.508093 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.508346 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.508595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.509096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.509370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.509628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.509888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.510147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.510413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.510672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.510937 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.511190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.511440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.511674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.511907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.512158 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.512408 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.512648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.512886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.513124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.513357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.513605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.513894 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.514129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.514473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.514787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.514911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.515061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.515322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.515557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.515796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.516071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.516315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.516548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.516812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.517086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.517353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.517603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.517852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.518112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.518404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.518657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.518930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.519204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.519468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.519720 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.519971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.520212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.520506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.520763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.521028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.521273 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.521542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.521804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.522376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.522376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.522550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.522830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.523111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.523391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.523664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.523933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.524215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.524484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.524748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.525000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.525241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.525485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.525723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] role.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.525973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] role.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.526207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.526461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.526729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.526996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.527250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.527502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.527752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.528002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.528254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.528493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.528763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.529035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.529871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.530297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.530789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.531069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.531358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.531616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.531870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.532136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.532399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.532796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.533079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.533339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.533577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.533816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.534055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.534313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.534571 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.534861 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.535090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.535331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.535563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.535802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.536043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.536315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.536579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.536852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.537125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.537389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.537670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.537942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.538214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.538474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.538759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.539025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.539286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.539540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.539774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.540040 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.540358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.540623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.connection = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.540871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.541123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.541365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.541609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.541845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.542084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.542341 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.542611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.542907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.543168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.543357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.543443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.543587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.543670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.543885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.544124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.544371 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.544603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.544843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.545290 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 17:52:55.545502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 17:52:55.572025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.572259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.572507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.583453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.596684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.603437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.603686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.643794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.647307 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.647542 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.683786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.684018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.713130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.713358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.713577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.713794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.714010 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.714222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.729713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.729948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.730197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.730450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.730694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.730965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.737601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.737831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.738053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.738275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.738494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.738723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.738938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.744381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.744643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.744889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.745117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.745373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.745613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.745849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.750118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.754377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.762643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.762906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.763128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.763346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.763561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.764363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.764605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.766900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.767155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.767399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.767623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.767843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.768080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.768319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80382) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 17:52:55.784127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.784334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 17:52:55.784665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.784863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 17:52:55.784985 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.785126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.785210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 17:52:55.785377 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.785518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.785625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.785715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 17:52:55.785871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.785957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.786218 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.786479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.786764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.796857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.797127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.797392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.797669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.800348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.800662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.800954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.801258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.805740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.809019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.809294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.809569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.809849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.809933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.810125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.810377 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.810810 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.811081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.811346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.811754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.812022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.813724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.814024 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.814325 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.814641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.814970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.815252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.815525 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.815832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.816228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.816542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.816813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.838950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.840664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.840934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.846235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.846508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.846849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.846939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.848635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.848913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.854043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.854318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.854915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.855252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.855565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.859370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.859764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.860043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.860320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.860589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.860857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.861129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.861392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.864125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.864405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.869180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.869464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.869744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.870025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.870411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.870689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.870988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.871260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.879994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.880266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.885178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.889507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.889811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.892311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.892625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.894840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.897692 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.898413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.901417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.901731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.902189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.902482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.902796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.903077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.903355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.903628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.907194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.911178 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.915150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.915479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.915777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.916211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.916538 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.916850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.923335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.923611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.923871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.924127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.932116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.933820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.934090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.937323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.937470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.937596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.937693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.937878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.937962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.938154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.938237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.938426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.946596 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.948391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.948690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.952468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.952623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.952738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.952932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.953015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.953242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.953339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.953544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.953634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.953812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.953896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.954218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.969516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.969792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.970071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.970349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.970630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.970937 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.971220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.972719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.976001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.979313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.980904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.982592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.982918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.983263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.990256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.990586 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.992205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.993951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:55.995535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.995821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.996100 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.996369 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.997530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:55.999310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.001082 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:56.001371 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.001654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.005633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:56.005912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.006287 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.009809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.011577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:56.015010 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:56.015285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.015560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.015643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.015832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.015916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.016097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.016179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.016362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.016454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.016644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.016906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.017175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.017443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.017706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.017960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.018230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.018484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.026046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:56.026330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.026607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.035802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80382) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 17:52:56.036111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.036412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.036713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.037004 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.037333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.037642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.037936 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.038230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.038554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.038857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.039131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.039395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.039660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80382) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 17:52:56.057646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c5bf0749c0 pid: 80381 (default app) May 23 17:52:56.060881 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921995e-a179-4c4d-9068-2018e7a9bf15 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:52:56.061175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921995e-a179-4c4d-9068-2018e7a9bf15 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:52:56.061446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921995e-a179-4c4d-9068-2018e7a9bf15 None None] PATH_INFO: `/v3` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:52:56.065685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Mon May 23 17:52:56 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:52:56.081576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c5bf0749c0 pid: 80382 (default app) May 23 17:53:03.993525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a0da6-54c6-4e4b-a972-22c09f0a4977 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:03.994080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a0da6-54c6-4e4b-a972-22c09f0a4977 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:03.994080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a0da6-54c6-4e4b-a972-22c09f0a4977 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:03.995426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:04.002818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:04.003237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:04.003370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:04.069531 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: INFO dbcounter [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] Registered counter for database keystone May 23 17:53:04.091112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG oslo_db.sqlalchemy.engines [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:53:04.097983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writer thread running {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:53:04.280526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG passlib.handlers.bcrypt [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80382) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 17:53:04.280928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG passlib.handlers.bcrypt [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80382) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 17:53:04.337497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:04.339104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:04.462391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1/3] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 17:53:04.624120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a0da6-54c6-4e4b-a972-22c09f0a4977 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:04.693363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: INFO dbcounter [None req-9e8a0da6-54c6-4e4b-a972-22c09f0a4977 None None] Registered counter for database keystone May 23 17:53:04.713911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG oslo_db.sqlalchemy.engines [None req-9e8a0da6-54c6-4e4b-a972-22c09f0a4977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 17:53:04.720344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writer thread running {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 17:53:04.840535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a0da6-54c6-4e4b-a972-22c09f0a4977 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:04.844949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e0af8-c33c-4b4a-a920-0b72d38377ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:04.845604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0af8-c33c-4b4a-a920-0b72d38377ff admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:04.845884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0af8-c33c-4b4a-a920-0b72d38377ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:04.846160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0af8-c33c-4b4a-a920-0b72d38377ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:04.854115 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e0af8-c33c-4b4a-a920-0b72d38377ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:04.907522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: WARNING keystone.common.rbac_enforcer.enforcer [None req-039e0af8-c33c-4b4a-a920-0b72d38377ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 17:53:04.907862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e0af8-c33c-4b4a-a920-0b72d38377ff admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:04.917412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1324 bytes} [Mon May 23 17:53:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:53:04.924266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:04.939160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a500e-17a5-4ac7-82ea-a7275d3fadf8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:04.943486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7e21d-bc4d-4000-a314-f6fe10d8b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:04.944595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7e21d-bc4d-4000-a314-f6fe10d8b0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:04.944877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7e21d-bc4d-4000-a314-f6fe10d8b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:04.945148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7e21d-bc4d-4000-a314-f6fe10d8b0c1 admin admin] PATH_INFO: `/v3/projects/883a3e766acb4bf0a201fc243774389f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:04.946774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7e21d-bc4d-4000-a314-f6fe10d8b0c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=883a3e766acb4bf0a201fc243774389f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:04.999722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: WARNING keystone.common.rbac_enforcer.enforcer [None req-15d7e21d-bc4d-4000-a314-f6fe10d8b0c1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 17:53:05.000063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7e21d-bc4d-4000-a314-f6fe10d8b0c1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:05.004569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 2/5] 10.222.0.30 () {56 vars in 1207 bytes} [Mon May 23 17:53:04 2022] GET /identity/v3/projects/883a3e766acb4bf0a201fc243774389f => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:07.176381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b107b-e30c-46cf-b7fd-d04583eb44d0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:07.176918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b107b-e30c-46cf-b7fd-d04583eb44d0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:07.176918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b107b-e30c-46cf-b7fd-d04583eb44d0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:07.181008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 4/6] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:07.186544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf2a5d-f4e5-41be-be8e-02daa41f21e3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:07.186959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf2a5d-f4e5-41be-be8e-02daa41f21e3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:07.187130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf2a5d-f4e5-41be-be8e-02daa41f21e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:07.206233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0adf2a5d-f4e5-41be-be8e-02daa41f21e3 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:07.207780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0adf2a5d-f4e5-41be-be8e-02daa41f21e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:07.215523 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 3/7] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 23 17:53:07.237803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b107b-e30c-46cf-b7fd-d04583eb44d0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:07.249722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b107b-e30c-46cf-b7fd-d04583eb44d0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:07.253892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a315b56-a790-4822-ae6d-aede081c2c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:07.254520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a315b56-a790-4822-ae6d-aede081c2c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:07.254835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a315b56-a790-4822-ae6d-aede081c2c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:07.255113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a315b56-a790-4822-ae6d-aede081c2c30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:07.262985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a315b56-a790-4822-ae6d-aede081c2c30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:07.265363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a315b56-a790-4822-ae6d-aede081c2c30 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:07.274262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 5/8] 10.222.0.30 () {58 vars in 1324 bytes} [Mon May 23 17:53:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 17:53:07.280000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf2a5d-f4e5-41be-be8e-02daa41f21e3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:07.289565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf2a5d-f4e5-41be-be8e-02daa41f21e3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:07.293933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b7a21-f740-4dd0-b1d1-65cd7518c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:07.294849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7a21-f740-4dd0-b1d1-65cd7518c665 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:07.295131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7a21-f740-4dd0-b1d1-65cd7518c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:07.295450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7a21-f740-4dd0-b1d1-65cd7518c665 admin admin] PATH_INFO: `/v3/users/1f5dea6992a4447085d8377492272c61` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:07.296863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b7a21-f740-4dd0-b1d1-65cd7518c665 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f5dea6992a4447085d8377492272c61)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:07.298684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b7a21-f740-4dd0-b1d1-65cd7518c665 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:07.300286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 4/9] 10.222.0.30 () {56 vars in 1198 bytes} [Mon May 23 17:53:07 2022] GET /identity/v3/users/1f5dea6992a4447085d8377492272c61 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:09.551235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aacce7-b94c-4da8-9040-d82096f34e88 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:09.551713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aacce7-b94c-4da8-9040-d82096f34e88 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:09.551806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aacce7-b94c-4da8-9040-d82096f34e88 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:09.553140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:09.558470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a102280-42df-4d09-9a3f-8428c6919ba2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:09.558931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a102280-42df-4d09-9a3f-8428c6919ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:09.559182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a102280-42df-4d09-9a3f-8428c6919ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:09.563438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31440e71-6120-47fc-a6c4-f48e00345031 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:09.563728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31440e71-6120-47fc-a6c4-f48e00345031 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:09.564003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31440e71-6120-47fc-a6c4-f48e00345031 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:09.565275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 7/11] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:09.570168 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694611d-a086-4b18-8eaf-10874c630bad None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:09.570450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694611d-a086-4b18-8eaf-10874c630bad None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:09.570751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694611d-a086-4b18-8eaf-10874c630bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:09.576625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2a102280-42df-4d09-9a3f-8428c6919ba2 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:09.577813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2a102280-42df-4d09-9a3f-8428c6919ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:09.610981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG passlib.handlers.bcrypt [None req-b694611d-a086-4b18-8eaf-10874c630bad None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80381) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 17:53:09.611409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG passlib.handlers.bcrypt [None req-b694611d-a086-4b18-8eaf-10874c630bad None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80381) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 17:53:09.657738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 5/12] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:09.658664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b694611d-a086-4b18-8eaf-10874c630bad None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:09.660281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b694611d-a086-4b18-8eaf-10874c630bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:09.680669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a102280-42df-4d09-9a3f-8428c6919ba2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:09.705282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:09.761812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 8/13] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:09.784155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a102280-42df-4d09-9a3f-8428c6919ba2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:09.784302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694611d-a086-4b18-8eaf-10874c630bad None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:09.820950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eacd88-c756-4887-95a1-d607c708114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:09.821767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eacd88-c756-4887-95a1-d607c708114e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:09.822056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eacd88-c756-4887-95a1-d607c708114e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:09.822335 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eacd88-c756-4887-95a1-d607c708114e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:09.835380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eacd88-c756-4887-95a1-d607c708114e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f1eacd88-c756-4887-95a1-d607c708114e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:09.847666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:09.848780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:09.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 6/14] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:53:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:53:09.854955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eacd88-c756-4887-95a1-d607c708114e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:10.003295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694611d-a086-4b18-8eaf-10874c630bad None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:10.005828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:10.043942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384e9a3-5030-4b01-b1b5-d2a16e707637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:10.044797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e9a3-5030-4b01-b1b5-d2a16e707637 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:10.045085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e9a3-5030-4b01-b1b5-d2a16e707637 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:10.045364 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e9a3-5030-4b01-b1b5-d2a16e707637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:10.052924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:10.072481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eacd88-c756-4887-95a1-d607c708114e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:10.106222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5ab56-11a4-4cba-809d-009d631644f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:10.106959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ab56-11a4-4cba-809d-009d631644f5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:10.107253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ab56-11a4-4cba-809d-009d631644f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:10.107531 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ab56-11a4-4cba-809d-009d631644f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:10.108281 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5ab56-11a4-4cba-809d-009d631644f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:10.108592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5ab56-11a4-4cba-809d-009d631644f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:10.109971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5ab56-11a4-4cba-809d-009d631644f5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:10.114579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384e9a3-5030-4b01-b1b5-d2a16e707637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:10.116125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384e9a3-5030-4b01-b1b5-d2a16e707637 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:10.121643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 7/15] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:10.127372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5ab56-11a4-4cba-809d-009d631644f5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:10.212605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 9/16] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:53:10.218544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384e9a3-5030-4b01-b1b5-d2a16e707637 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:10.221212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:10.230470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5ab56-11a4-4cba-809d-009d631644f5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:10.264860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0f790-d813-4f8b-aad0-c11abc2460d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:10.265759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f790-d813-4f8b-aad0-c11abc2460d5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:10.266074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f790-d813-4f8b-aad0-c11abc2460d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:10.266353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f790-d813-4f8b-aad0-c11abc2460d5 None admin] PATH_INFO: `/v3/users/1f5dea6992a4447085d8377492272c61` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:10.267595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0f790-d813-4f8b-aad0-c11abc2460d5 None admin] RBAC: Authorizing `identity:get_user(user_id=1f5dea6992a4447085d8377492272c61)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:10.269851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0f790-d813-4f8b-aad0-c11abc2460d5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:10.272529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 8/17] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:10 2022] GET /identity/v3/users/1f5dea6992a4447085d8377492272c61 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:10.277912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0f790-d813-4f8b-aad0-c11abc2460d5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:10.293279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:10.324366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384e9a3-5030-4b01-b1b5-d2a16e707637 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:10.360428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f0bd4-7ae3-45de-8d61-940470d2bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:10.361615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f0bd4-7ae3-45de-8d61-940470d2bb60 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:10.361902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f0bd4-7ae3-45de-8d61-940470d2bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:10.362181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f0bd4-7ae3-45de-8d61-940470d2bb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:10.382130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f0bd4-7ae3-45de-8d61-940470d2bb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:10.383636 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f0bd4-7ae3-45de-8d61-940470d2bb60 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:10.385840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0f790-d813-4f8b-aad0-c11abc2460d5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-834f0bd4-7ae3-45de-8d61-940470d2bb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:53:10.405538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:10.406587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:10.407473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:53:10.407473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:53:10.407473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:53:10.407473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:10.407473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 10/18] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:53:10.412630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f0bd4-7ae3-45de-8d61-940470d2bb60 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:10.420779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89f837-a941-40ad-a66d-8ff28be6d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:10.421574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89f837-a941-40ad-a66d-8ff28be6d316 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:10.421863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89f837-a941-40ad-a66d-8ff28be6d316 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:10.422140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89f837-a941-40ad-a66d-8ff28be6d316 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:10.423333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89f837-a941-40ad-a66d-8ff28be6d316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:10.424790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89f837-a941-40ad-a66d-8ff28be6d316 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:10.426377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 9/19] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:10.431962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89f837-a941-40ad-a66d-8ff28be6d316 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:10.471396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:10.512623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:10.517105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f0bd4-7ae3-45de-8d61-940470d2bb60 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:10.533580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89f837-a941-40ad-a66d-8ff28be6d316 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:10.553183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d7cd2-7f61-420d-bceb-2870ce66d212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:10.553850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7cd2-7f61-420d-bceb-2870ce66d212 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:10.554133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7cd2-7f61-420d-bceb-2870ce66d212 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:10.554412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7cd2-7f61-420d-bceb-2870ce66d212 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:10.555172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7cd2-7f61-420d-bceb-2870ce66d212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:10.555483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7cd2-7f61-420d-bceb-2870ce66d212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:10.556900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7cd2-7f61-420d-bceb-2870ce66d212 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:10.569905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e3f9b-1583-42f8-bc4e-ce49ad328175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:10.570567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e3f9b-1583-42f8-bc4e-ce49ad328175 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:10.570884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e3f9b-1583-42f8-bc4e-ce49ad328175 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:10.571162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e3f9b-1583-42f8-bc4e-ce49ad328175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:10.571989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e3f9b-1583-42f8-bc4e-ce49ad328175 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.domain.id=default, user.id=1f5dea6992a4447085d8377492272c61) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:10.572297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e3f9b-1583-42f8-bc4e-ce49ad328175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:10.573751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e3f9b-1583-42f8-bc4e-ce49ad328175 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:10.575638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:10.587746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1322 bytes} [Mon May 23 17:53:10 2022] GET /identity/v3/role_assignments?user.id=1f5dea6992a4447085d8377492272c61&scope.domain.id=default&role.id=af8084c48e3c40298e26d44d6d14595a => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:13.259925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b313-6279-433d-ab7d-7fb976db5bdb None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:13.260961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b313-6279-433d-ab7d-7fb976db5bdb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:13.261475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b313-6279-433d-ab7d-7fb976db5bdb None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:13.264022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:13.269648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42a6e6-3e43-4cc4-9268-bd983c4be62d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:13.270206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42a6e6-3e43-4cc4-9268-bd983c4be62d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:13.270323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42a6e6-3e43-4cc4-9268-bd983c4be62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:13.295727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-bd42a6e6-3e43-4cc4-9268-bd983c4be62d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:13.296943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bd42a6e6-3e43-4cc4-9268-bd983c4be62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:13.343964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9e3c9-cc0a-474f-9b9b-761c60ff64a5 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:13.344872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9e3c9-cc0a-474f-9b9b-761c60ff64a5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:13.345356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9e3c9-cc0a-474f-9b9b-761c60ff64a5 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:13.347178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 13/23] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:13.352646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a5f45-cb1a-4361-9532-f9a46bfb096e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:13.353191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a5f45-cb1a-4361-9532-f9a46bfb096e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:13.353668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a5f45-cb1a-4361-9532-f9a46bfb096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:13.371804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-485a5f45-cb1a-4361-9532-f9a46bfb096e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:13.373916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-485a5f45-cb1a-4361-9532-f9a46bfb096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:13.403442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 11/24] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:13.440239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42a6e6-3e43-4cc4-9268-bd983c4be62d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:13.462400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 14/25] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:13.505253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a5f45-cb1a-4361-9532-f9a46bfb096e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:13.615113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:13.626493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:13.684581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42a6e6-3e43-4cc4-9268-bd983c4be62d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:13.738147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a5f45-cb1a-4361-9532-f9a46bfb096e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:13.752114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2416f38-70f9-4f80-9bd4-2312f715b720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:13.752920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2416f38-70f9-4f80-9bd4-2312f715b720 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:13.753263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2416f38-70f9-4f80-9bd4-2312f715b720 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:13.753547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2416f38-70f9-4f80-9bd4-2312f715b720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:13.772184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2416f38-70f9-4f80-9bd4-2312f715b720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:13.774216 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2416f38-70f9-4f80-9bd4-2312f715b720 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f2416f38-70f9-4f80-9bd4-2312f715b720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:53:13.797144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:13.798050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:13.799400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:53:13.799400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:53:13.799400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:53:13.799400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:13.801064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 12/26] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:53:13.802918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f356-3981-4461-a88c-5f460d072a9f None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:13.803622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f356-3981-4461-a88c-5f460d072a9f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:13.804048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f356-3981-4461-a88c-5f460d072a9f None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:13.805986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:13.811248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f356-3981-4461-a88c-5f460d072a9f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:13.815135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d7961-3c1d-4847-891a-4ee0634a958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:13.816232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d7961-3c1d-4847-891a-4ee0634a958f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:13.816728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d7961-3c1d-4847-891a-4ee0634a958f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:13.817206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d7961-3c1d-4847-891a-4ee0634a958f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:13.830194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d7961-3c1d-4847-891a-4ee0634a958f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-f53d7961-3c1d-4847-891a-4ee0634a958f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:13.842326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:13.843264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:13.844096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:13.846496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 15/28] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:53:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:13.848068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44af999-3139-4c9c-a994-1680bee18015 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:13.848578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44af999-3139-4c9c-a994-1680bee18015 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:13.849055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44af999-3139-4c9c-a994-1680bee18015 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:13.850615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 16/29] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:13.851955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d82b12-e79f-4061-a36f-acc15c24a1ba None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:13.852456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d82b12-e79f-4061-a36f-acc15c24a1ba None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:13.852942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d82b12-e79f-4061-a36f-acc15c24a1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:13.871247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-01d82b12-e79f-4061-a36f-acc15c24a1ba None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:13.873112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-01d82b12-e79f-4061-a36f-acc15c24a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:13.950145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f356-3981-4461-a88c-5f460d072a9f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:13.954432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 17/30] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:13.956017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e5f5-66bf-49cd-a5a3-025f434ef370 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:13.956538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e5f5-66bf-49cd-a5a3-025f434ef370 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:13.957046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e5f5-66bf-49cd-a5a3-025f434ef370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:13.979252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-45b5e5f5-66bf-49cd-a5a3-025f434ef370 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:13.980806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-45b5e5f5-66bf-49cd-a5a3-025f434ef370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:13.996004 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:14.008283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65052-9126-4f61-a067-e64412731120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:14.009760 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65052-9126-4f61-a067-e64412731120 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:14.010196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65052-9126-4f61-a067-e64412731120 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:14.010841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65052-9126-4f61-a067-e64412731120 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:14.012065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f65052-9126-4f61-a067-e64412731120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:14.012800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f65052-9126-4f61-a067-e64412731120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:14.015178 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f65052-9126-4f61-a067-e64412731120 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:14.018027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:14.040244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 14/31] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:14.041845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65052-9126-4f61-a067-e64412731120 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:14.067569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 18/32] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:14.068715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5e5f5-66bf-49cd-a5a3-025f434ef370 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:14.166407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65052-9126-4f61-a067-e64412731120 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:14.185842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5e5f5-66bf-49cd-a5a3-025f434ef370 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:14.204966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c8a9-def2-4f54-89dc-c7aedb38d16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:14.205945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c8a9-def2-4f54-89dc-c7aedb38d16d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:14.206397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c8a9-def2-4f54-89dc-c7aedb38d16d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:14.206851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c8a9-def2-4f54-89dc-c7aedb38d16d None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:14.207742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c8a9-def2-4f54-89dc-c7aedb38d16d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:14.208190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c8a9-def2-4f54-89dc-c7aedb38d16d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:14.209810 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c8a9-def2-4f54-89dc-c7aedb38d16d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:14.219845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 15/33] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:14.220874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c8a9-def2-4f54-89dc-c7aedb38d16d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:14.226068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c57526-a32e-4470-8bde-9e58116155b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:14.227002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c57526-a32e-4470-8bde-9e58116155b9 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:14.227448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c57526-a32e-4470-8bde-9e58116155b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:14.227896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c57526-a32e-4470-8bde-9e58116155b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:14.228795 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c57526-a32e-4470-8bde-9e58116155b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:14.230340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c57526-a32e-4470-8bde-9e58116155b9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:14.282139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:14.338257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c8a9-def2-4f54-89dc-c7aedb38d16d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:14.373961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed30f-02cf-425e-beb6-3858a8af0bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:14.374824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed30f-02cf-425e-beb6-3858a8af0bde None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:14.375357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed30f-02cf-425e-beb6-3858a8af0bde None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:14.375833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed30f-02cf-425e-beb6-3858a8af0bde None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:14.376763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ed30f-02cf-425e-beb6-3858a8af0bde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:14.378417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ed30f-02cf-425e-beb6-3858a8af0bde None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:14.391246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 19/34] 10.222.0.30 () {60 vars in 1131 bytes} [Mon May 23 17:53:14 2022] POST /identity/v3/roles => generated 225 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:14.392920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c57526-a32e-4470-8bde-9e58116155b9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:14.428604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:14.528382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c57526-a32e-4470-8bde-9e58116155b9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:14.536858 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 16/35] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:53:14 2022] POST /identity/v3/projects => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:14.538519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed30f-02cf-425e-beb6-3858a8af0bde None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:14.571439 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389755-6d05-47a7-9fac-95cb6e91d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:14.572396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389755-6d05-47a7-9fac-95cb6e91d7f6 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:14.572829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389755-6d05-47a7-9fac-95cb6e91d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:14.573273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389755-6d05-47a7-9fac-95cb6e91d7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:14.574294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389755-6d05-47a7-9fac-95cb6e91d7f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:14.576873 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389755-6d05-47a7-9fac-95cb6e91d7f6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:14.604510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 20/36] 10.222.0.30 () {60 vars in 1131 bytes} [Mon May 23 17:53:14 2022] POST /identity/v3/roles => generated 219 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:14.605991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee57b12-a379-4017-be76-2633132e1912 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:14.606291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee57b12-a379-4017-be76-2633132e1912 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:14.606578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee57b12-a379-4017-be76-2633132e1912 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:14.608517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 21/37] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:14.614222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afdf83-f5fd-47e4-bcca-3eab3f1dbd40 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:14.614767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afdf83-f5fd-47e4-bcca-3eab3f1dbd40 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:14.615219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afdf83-f5fd-47e4-bcca-3eab3f1dbd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:14.640913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-02afdf83-f5fd-47e4-bcca-3eab3f1dbd40 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:14.643704 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-02afdf83-f5fd-47e4-bcca-3eab3f1dbd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:14.665090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:14.668667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed30f-02cf-425e-beb6-3858a8af0bde None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:14.721066 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12b0ac-de38-4439-9c4f-2631dcdee1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:14.721980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12b0ac-de38-4439-9c4f-2631dcdee1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:14.722272 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12b0ac-de38-4439-9c4f-2631dcdee1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:14.722553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12b0ac-de38-4439-9c4f-2631dcdee1f3 None admin] PATH_INFO: `/v3/users/1f5dea6992a4447085d8377492272c61` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:14.724036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12b0ac-de38-4439-9c4f-2631dcdee1f3 None admin] RBAC: Authorizing `identity:get_user(user_id=1f5dea6992a4447085d8377492272c61)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:14.725662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12b0ac-de38-4439-9c4f-2631dcdee1f3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:14.727735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 17/38] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:14 2022] GET /identity/v3/users/1f5dea6992a4447085d8377492272c61 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:14.735780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12b0ac-de38-4439-9c4f-2631dcdee1f3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:14.784550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 22/39] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:14.853471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afdf83-f5fd-47e4-bcca-3eab3f1dbd40 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:14.881545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:14.914694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12b0ac-de38-4439-9c4f-2631dcdee1f3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:14.961625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a79f-ed54-469d-a4f8-1b74c0c1fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:14.962435 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a79f-ed54-469d-a4f8-1b74c0c1fe24 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:14.962756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a79f-ed54-469d-a4f8-1b74c0c1fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:14.963027 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a79f-ed54-469d-a4f8-1b74c0c1fe24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:14.964418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a79f-ed54-469d-a4f8-1b74c0c1fe24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:14.965893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a79f-ed54-469d-a4f8-1b74c0c1fe24 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:14.967621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 18/40] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:14.973339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a79f-ed54-469d-a4f8-1b74c0c1fe24 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:14.991122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afdf83-f5fd-47e4-bcca-3eab3f1dbd40 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:15.012581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:15.031507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3424eb-1cb5-46da-b998-5cef2dfef9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:15.032206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3424eb-1cb5-46da-b998-5cef2dfef9b0 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:15.032496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3424eb-1cb5-46da-b998-5cef2dfef9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:15.032777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3424eb-1cb5-46da-b998-5cef2dfef9b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:15.033570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3424eb-1cb5-46da-b998-5cef2dfef9b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:15.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3424eb-1cb5-46da-b998-5cef2dfef9b0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:15.052060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 23/41] 10.222.0.30 () {60 vars in 1131 bytes} [Mon May 23 17:53:14 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:53:15.095600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a79f-ed54-469d-a4f8-1b74c0c1fe24 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:15.134139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f1229-8cf7-41e6-adfc-b668b9c1f750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:15.135075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1229-8cf7-41e6-adfc-b668b9c1f750 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:15.135367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1229-8cf7-41e6-adfc-b668b9c1f750 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:15.135654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1229-8cf7-41e6-adfc-b668b9c1f750 None admin] PATH_INFO: `/v3/domains/default/users/1f5dea6992a4447085d8377492272c61/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:15.137786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f1229-8cf7-41e6-adfc-b668b9c1f750 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1f5dea6992a4447085d8377492272c61, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:15.139928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f1229-8cf7-41e6-adfc-b668b9c1f750 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:15.155948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 19/42] 10.222.0.30 () {58 vars in 1361 bytes} [Mon May 23 17:53:14 2022] PUT /identity/v3/domains/default/users/1f5dea6992a4447085d8377492272c61/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:53:15.239003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681c1ac-ac87-4aca-b7d9-a9e1c2fddc43 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:15.240203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681c1ac-ac87-4aca-b7d9-a9e1c2fddc43 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:15.240500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681c1ac-ac87-4aca-b7d9-a9e1c2fddc43 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:15.242073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 24/43] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:15.248919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd301a1-2976-4242-8401-047e9b00c8a2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:15.249214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd301a1-2976-4242-8401-047e9b00c8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:15.249498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd301a1-2976-4242-8401-047e9b00c8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:15.269131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6cd301a1-2976-4242-8401-047e9b00c8a2 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:15.270746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6cd301a1-2976-4242-8401-047e9b00c8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:15.348716 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 20/44] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:15.373191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681c1ac-ac87-4aca-b7d9-a9e1c2fddc43 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:15.450666 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:15.475445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681c1ac-ac87-4aca-b7d9-a9e1c2fddc43 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:15.510083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797a062-e381-406a-a94c-8cde803c44be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:15.510907 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797a062-e381-406a-a94c-8cde803c44be None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:15.511195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797a062-e381-406a-a94c-8cde803c44be None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:15.511531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797a062-e381-406a-a94c-8cde803c44be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:15.513022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797a062-e381-406a-a94c-8cde803c44be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:15.514492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797a062-e381-406a-a94c-8cde803c44be None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:15.516339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 25/45] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:15.522128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd301a1-2976-4242-8401-047e9b00c8a2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:15.548644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:15.622301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd301a1-2976-4242-8401-047e9b00c8a2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:15.656542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784e637-219d-4b20-85a8-4ee141058079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:15.657214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784e637-219d-4b20-85a8-4ee141058079 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:15.657506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784e637-219d-4b20-85a8-4ee141058079 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:15.657789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784e637-219d-4b20-85a8-4ee141058079 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:15.658519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784e637-219d-4b20-85a8-4ee141058079 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:15.660014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784e637-219d-4b20-85a8-4ee141058079 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:15.685129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 21/46] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:53:15 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:17.402234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bfe96-4d5f-44e9-bbc2-7862011428f5 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:17.402765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bfe96-4d5f-44e9-bbc2-7862011428f5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:17.402848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bfe96-4d5f-44e9-bbc2-7862011428f5 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:17.404847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 26/47] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:17.410139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886814a-490f-4bf5-a085-2e0d0a2d3ce8 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:17.410540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886814a-490f-4bf5-a085-2e0d0a2d3ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:17.410883 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886814a-490f-4bf5-a085-2e0d0a2d3ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:17.428397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0886814a-490f-4bf5-a085-2e0d0a2d3ce8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:17.429583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0886814a-490f-4bf5-a085-2e0d0a2d3ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:17.498328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 22/48] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:17.522555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bfe96-4d5f-44e9-bbc2-7862011428f5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:17.624438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bfe96-4d5f-44e9-bbc2-7862011428f5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:17.657891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20919a-22c1-481c-9234-8a95d068fcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:17.658607 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20919a-22c1-481c-9234-8a95d068fcea None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:17.658915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20919a-22c1-481c-9234-8a95d068fcea None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:17.659192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20919a-22c1-481c-9234-8a95d068fcea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:17.668971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20919a-22c1-481c-9234-8a95d068fcea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-ba20919a-22c1-481c-9234-8a95d068fcea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:17.677901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:17.678823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:17.679585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 27/49] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:17.686957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886814a-490f-4bf5-a085-2e0d0a2d3ce8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:17.697014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:17.789011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886814a-490f-4bf5-a085-2e0d0a2d3ce8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:17.821306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a21647-44fb-40ef-9d82-b1ae704f1b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:17.821970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a21647-44fb-40ef-9d82-b1ae704f1b59 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:17.822256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a21647-44fb-40ef-9d82-b1ae704f1b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:17.822534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a21647-44fb-40ef-9d82-b1ae704f1b59 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:17.823323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a21647-44fb-40ef-9d82-b1ae704f1b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:17.823632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a21647-44fb-40ef-9d82-b1ae704f1b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:17.825013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a21647-44fb-40ef-9d82-b1ae704f1b59 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:17.833676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 23/50] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:17.839147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20919a-22c1-481c-9234-8a95d068fcea None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:17.844406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:17.920052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7607c-7358-4fe2-9518-3aab5a081fdb None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:17.920274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7607c-7358-4fe2-9518-3aab5a081fdb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:17.920562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7607c-7358-4fe2-9518-3aab5a081fdb None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:17.921955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 24/51] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:17.926858 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525704c2-d6d1-4dac-94d4-43e5d5697fe7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:17.927150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525704c2-d6d1-4dac-94d4-43e5d5697fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:17.927437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525704c2-d6d1-4dac-94d4-43e5d5697fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:17.942730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20919a-22c1-481c-9234-8a95d068fcea None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:17.944412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-525704c2-d6d1-4dac-94d4-43e5d5697fe7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:17.945618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-525704c2-d6d1-4dac-94d4-43e5d5697fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:17.976236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019786db-ceb7-42b1-9a00-238ce0d6d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:17.977107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019786db-ceb7-42b1-9a00-238ce0d6d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:17.977392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019786db-ceb7-42b1-9a00-238ce0d6d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:17.977672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019786db-ceb7-42b1-9a00-238ce0d6d9c0 None admin] PATH_INFO: `/v3/users/1f5dea6992a4447085d8377492272c61` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:17.979096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019786db-ceb7-42b1-9a00-238ce0d6d9c0 None admin] RBAC: Authorizing `identity:get_user(user_id=1f5dea6992a4447085d8377492272c61)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:17.980580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019786db-ceb7-42b1-9a00-238ce0d6d9c0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:17.982283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 28/52] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:17 2022] GET /identity/v3/users/1f5dea6992a4447085d8377492272c61 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:17.988046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019786db-ceb7-42b1-9a00-238ce0d6d9c0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:18.008263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:18.014611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 25/53] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:18.036774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525704c2-d6d1-4dac-94d4-43e5d5697fe7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:18.057692 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:18.088256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019786db-ceb7-42b1-9a00-238ce0d6d9c0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:18.121963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8bd6-7ab9-47c3-9efc-bd4f2deb6652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:18.122904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8bd6-7ab9-47c3-9efc-bd4f2deb6652 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:18.123193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8bd6-7ab9-47c3-9efc-bd4f2deb6652 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:18.123475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8bd6-7ab9-47c3-9efc-bd4f2deb6652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:18.124669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c8bd6-7ab9-47c3-9efc-bd4f2deb6652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:18.126124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c8bd6-7ab9-47c3-9efc-bd4f2deb6652 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:18.127788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 29/54] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:18.133315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8bd6-7ab9-47c3-9efc-bd4f2deb6652 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:18.136965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525704c2-d6d1-4dac-94d4-43e5d5697fe7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:18.171137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f0cf0-6b11-4186-820b-590e46773c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:18.171855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f0cf0-6b11-4186-820b-590e46773c07 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:18.172145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f0cf0-6b11-4186-820b-590e46773c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:18.172421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f0cf0-6b11-4186-820b-590e46773c07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:18.173592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f0cf0-6b11-4186-820b-590e46773c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:18.175063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f0cf0-6b11-4186-820b-590e46773c07 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:18.176677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 26/55] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:18.182087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f0cf0-6b11-4186-820b-590e46773c07 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:18.234979 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8bd6-7ab9-47c3-9efc-bd4f2deb6652 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:18.247445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:18.268970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d11c9-7ec4-48b8-b4a0-0645348eb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:18.269632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d11c9-7ec4-48b8-b4a0-0645348eb349 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:18.270141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d11c9-7ec4-48b8-b4a0-0645348eb349 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:18.270439 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d11c9-7ec4-48b8-b4a0-0645348eb349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:18.271400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d11c9-7ec4-48b8-b4a0-0645348eb349 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.domain.id=default, user.id=1f5dea6992a4447085d8377492272c61) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:18.271731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d11c9-7ec4-48b8-b4a0-0645348eb349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:18.273362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d11c9-7ec4-48b8-b4a0-0645348eb349 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:18.284158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 30/56] 10.222.0.30 () {56 vars in 1322 bytes} [Mon May 23 17:53:18 2022] GET /identity/v3/role_assignments?user.id=1f5dea6992a4447085d8377492272c61&scope.domain.id=default&role.id=af8084c48e3c40298e26d44d6d14595a => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:18.285382 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f0cf0-6b11-4186-820b-590e46773c07 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:18.321825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014261e-2549-4d9b-8da5-a84f3918ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:18.322509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014261e-2549-4d9b-8da5-a84f3918ec64 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:18.322833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014261e-2549-4d9b-8da5-a84f3918ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:18.323121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014261e-2549-4d9b-8da5-a84f3918ec64 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:18.323864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014261e-2549-4d9b-8da5-a84f3918ec64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:18.325883 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014261e-2549-4d9b-8da5-a84f3918ec64 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:18.354295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 27/57] 10.222.0.30 () {60 vars in 1140 bytes} [Mon May 23 17:53:18 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:20.603082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e25f5-44ac-4f4c-8403-55d1a93ca846 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:20.603542 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e25f5-44ac-4f4c-8403-55d1a93ca846 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:20.603648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e25f5-44ac-4f4c-8403-55d1a93ca846 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:20.605016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 31/58] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:20.610418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9748ef-7a43-4ef9-b8f5-99b6ccebb72c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:20.610838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9748ef-7a43-4ef9-b8f5-99b6ccebb72c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:20.611018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9748ef-7a43-4ef9-b8f5-99b6ccebb72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:20.627314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ba9748ef-7a43-4ef9-b8f5-99b6ccebb72c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:20.628482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ba9748ef-7a43-4ef9-b8f5-99b6ccebb72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:20.692386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 28/59] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:20.716489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e25f5-44ac-4f4c-8403-55d1a93ca846 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:20.720343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:20.817472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e25f5-44ac-4f4c-8403-55d1a93ca846 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:20.850861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198dea0-7be6-44b3-9e21-4edfaf7e504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:20.851650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198dea0-7be6-44b3-9e21-4edfaf7e504e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:20.851938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198dea0-7be6-44b3-9e21-4edfaf7e504e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:20.852217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198dea0-7be6-44b3-9e21-4edfaf7e504e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:20.853384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198dea0-7be6-44b3-9e21-4edfaf7e504e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:20.854865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198dea0-7be6-44b3-9e21-4edfaf7e504e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:20.856475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 32/60] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:20.862453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9748ef-7a43-4ef9-b8f5-99b6ccebb72c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:20.910739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:20.959974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9748ef-7a43-4ef9-b8f5-99b6ccebb72c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:20.995164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d955c-6931-491d-85e2-d7abbba4e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:20.995829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d955c-6931-491d-85e2-d7abbba4e576 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:20.996119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d955c-6931-491d-85e2-d7abbba4e576 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:20.996398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d955c-6931-491d-85e2-d7abbba4e576 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:20.997134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d955c-6931-491d-85e2-d7abbba4e576 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:20.998639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d955c-6931-491d-85e2-d7abbba4e576 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:21.022821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 29/61] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:53:20 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:53:24.494727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030932dd-b93a-448b-baae-f556adfb70b3 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:24.494727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030932dd-b93a-448b-baae-f556adfb70b3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:24.494727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030932dd-b93a-448b-baae-f556adfb70b3 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:24.495670 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 33/62] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:24.501491 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63144080-c8e9-4048-b8a0-fcf586692a99 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:24.502277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63144080-c8e9-4048-b8a0-fcf586692a99 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:24.502748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63144080-c8e9-4048-b8a0-fcf586692a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:24.539722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-63144080-c8e9-4048-b8a0-fcf586692a99 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:24.541155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-63144080-c8e9-4048-b8a0-fcf586692a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:24.629607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 30/63] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:24.646759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca26e-3f46-47ac-b468-3983b62c1748 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:24.647261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca26e-3f46-47ac-b468-3983b62c1748 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:24.647721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca26e-3f46-47ac-b468-3983b62c1748 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:24.649239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 34/64] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:24.654608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ef64-9ed8-4a91-9dc1-3208ce9eb81b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:24.654937 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ef64-9ed8-4a91-9dc1-3208ce9eb81b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:24.655221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140ef64-9ed8-4a91-9dc1-3208ce9eb81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:24.665514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eca26e-3f46-47ac-b468-3983b62c1748 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:24.673890 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c140ef64-9ed8-4a91-9dc1-3208ce9eb81b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:24.675145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c140ef64-9ed8-4a91-9dc1-3208ce9eb81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:24.729852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:24.788745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 31/65] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:24.811187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:24.820774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140ef64-9ed8-4a91-9dc1-3208ce9eb81b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:24.892488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eca26e-3f46-47ac-b468-3983b62c1748 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:24.937419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6ea44-efff-417a-8dc2-eedc0ffef13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:24.938509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6ea44-efff-417a-8dc2-eedc0ffef13a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:24.938826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6ea44-efff-417a-8dc2-eedc0ffef13a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:24.939322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6ea44-efff-417a-8dc2-eedc0ffef13a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:24.942777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140ef64-9ed8-4a91-9dc1-3208ce9eb81b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:24.955331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6ea44-efff-417a-8dc2-eedc0ffef13a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-08d6ea44-efff-417a-8dc2-eedc0ffef13a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:24.965885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:24.966963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:24.967741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:24.968334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 35/66] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:53:24.970735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657623f-a5a3-411f-b1f2-b1dac4dccfdc None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:24.970735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657623f-a5a3-411f-b1f2-b1dac4dccfdc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:24.970735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657623f-a5a3-411f-b1f2-b1dac4dccfdc None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:24.974992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 36/67] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:24.976731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb37fbc-4746-419d-a1b2-1e0c24a99bd2 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:24.977028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb37fbc-4746-419d-a1b2-1e0c24a99bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:24.977318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb37fbc-4746-419d-a1b2-1e0c24a99bd2 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:24.979390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 37/68] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:24.979942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb37fbc-4746-419d-a1b2-1e0c24a99bd2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:24.981048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41cd88-55aa-480f-9158-66ab79f616fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:24.982371 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41cd88-55aa-480f-9158-66ab79f616fa None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:24.982659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41cd88-55aa-480f-9158-66ab79f616fa None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:24.982962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41cd88-55aa-480f-9158-66ab79f616fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:24.993826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41cd88-55aa-480f-9158-66ab79f616fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5f41cd88-55aa-480f-9158-66ab79f616fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:25.002049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:25.003160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:25.004148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 32/69] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:53:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:25.005105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58ddc4-7ac0-4c54-8d3e-b4eef7944faa None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.005105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58ddc4-7ac0-4c54-8d3e-b4eef7944faa None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.005105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58ddc4-7ac0-4c54-8d3e-b4eef7944faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.021414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8e58ddc4-7ac0-4c54-8d3e-b4eef7944faa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:25.022598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8e58ddc4-7ac0-4c54-8d3e-b4eef7944faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:25.045975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:25.094027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb37fbc-4746-419d-a1b2-1e0c24a99bd2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:25.096370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 33/70] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:25.104510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79ed5-53cd-4b87-a012-1e95b3adf0ba None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.104963 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79ed5-53cd-4b87-a012-1e95b3adf0ba None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.105387 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79ed5-53cd-4b87-a012-1e95b3adf0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.127524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0ba79ed5-53cd-4b87-a012-1e95b3adf0ba None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:25.128797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:25.129166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0ba79ed5-53cd-4b87-a012-1e95b3adf0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:25.135418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5971ab-8872-4dbf-bb38-0ca7f3689908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:25.136105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5971ab-8872-4dbf-bb38-0ca7f3689908 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.136395 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5971ab-8872-4dbf-bb38-0ca7f3689908 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.136673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5971ab-8872-4dbf-bb38-0ca7f3689908 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.137424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5971ab-8872-4dbf-bb38-0ca7f3689908 None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:25.137736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5971ab-8872-4dbf-bb38-0ca7f3689908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:25.139158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5971ab-8872-4dbf-bb38-0ca7f3689908 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:25.150886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 38/71] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:25.151685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5971ab-8872-4dbf-bb38-0ca7f3689908 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:25.198989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 34/72] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:25.199726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79ed5-53cd-4b87-a012-1e95b3adf0ba None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:25.262043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5971ab-8872-4dbf-bb38-0ca7f3689908 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:25.285415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:25.295498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e0609-8d51-4dff-8d9f-3560be9e68cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:25.296235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e0609-8d51-4dff-8d9f-3560be9e68cc None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.296494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e0609-8d51-4dff-8d9f-3560be9e68cc None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.296749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e0609-8d51-4dff-8d9f-3560be9e68cc None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.297500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e0609-8d51-4dff-8d9f-3560be9e68cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:25.297816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e0609-8d51-4dff-8d9f-3560be9e68cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:25.299252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e0609-8d51-4dff-8d9f-3560be9e68cc None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:25.301493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79ed5-53cd-4b87-a012-1e95b3adf0ba None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:25.307653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 39/73] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:25.308698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d83e39-d111-41b7-a090-308abd09163a None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.308994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d83e39-d111-41b7-a090-308abd09163a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.309278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d83e39-d111-41b7-a090-308abd09163a None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.311142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 40/74] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:25.311848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d83e39-d111-41b7-a090-308abd09163a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:25.339155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207606d-a152-43e2-9d87-c33a0bfb8b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:25.339983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207606d-a152-43e2-9d87-c33a0bfb8b66 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.340267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207606d-a152-43e2-9d87-c33a0bfb8b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.340543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207606d-a152-43e2-9d87-c33a0bfb8b66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.351478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207606d-a152-43e2-9d87-c33a0bfb8b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c207606d-a152-43e2-9d87-c33a0bfb8b66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:25.360229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:25.361077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 35/75] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:53:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:25.366777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207606d-a152-43e2-9d87-c33a0bfb8b66 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:25.368900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:25.414553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d83e39-d111-41b7-a090-308abd09163a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:25.456707 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5cabb-692f-46be-9610-5ed77a340896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:25.457575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5cabb-692f-46be-9610-5ed77a340896 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.457855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5cabb-692f-46be-9610-5ed77a340896 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.458414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5cabb-692f-46be-9610-5ed77a340896 None admin] PATH_INFO: `/v3/users/0cf3f752e71f49dda8072b132321a74f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.467206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207606d-a152-43e2-9d87-c33a0bfb8b66 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:25.473807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5cabb-692f-46be-9610-5ed77a340896 None admin] RBAC: Authorizing `identity:get_user(user_id=0cf3f752e71f49dda8072b132321a74f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:25.475303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5cabb-692f-46be-9610-5ed77a340896 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:25.476984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 41/76] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:25 2022] GET /identity/v3/users/0cf3f752e71f49dda8072b132321a74f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:25.477743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5cabb-692f-46be-9610-5ed77a340896 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:25.504244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8356e94-dce7-40b3-8eb1-f6d406dee54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:25.505243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8356e94-dce7-40b3-8eb1-f6d406dee54c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.505526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8356e94-dce7-40b3-8eb1-f6d406dee54c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.505802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8356e94-dce7-40b3-8eb1-f6d406dee54c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.519294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8356e94-dce7-40b3-8eb1-f6d406dee54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f8356e94-dce7-40b3-8eb1-f6d406dee54c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:25.527077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:25.528009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:25.528984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 36/77] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:25.529607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5daebd-a765-4b61-b598-db22b1a2e5b3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.530505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5daebd-a765-4b61-b598-db22b1a2e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.530505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5daebd-a765-4b61-b598-db22b1a2e5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.541084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:25.546543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4c5daebd-a765-4b61-b598-db22b1a2e5b3 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:25.547707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4c5daebd-a765-4b61-b598-db22b1a2e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:25.584523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5cabb-692f-46be-9610-5ed77a340896 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:25.599253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:25.616050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 37/78] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:25.616894 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5daebd-a765-4b61-b598-db22b1a2e5b3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:25.619771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2935fd2-f277-4c03-9f05-34c0827b689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:25.620640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935fd2-f277-4c03-9f05-34c0827b689f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.620929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935fd2-f277-4c03-9f05-34c0827b689f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.621213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935fd2-f277-4c03-9f05-34c0827b689f None admin] PATH_INFO: `/v3/users/1f5dea6992a4447085d8377492272c61` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.623217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2935fd2-f277-4c03-9f05-34c0827b689f None admin] RBAC: Authorizing `identity:get_user(user_id=1f5dea6992a4447085d8377492272c61)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:25.624665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2935fd2-f277-4c03-9f05-34c0827b689f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:25.626275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 42/79] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:25 2022] GET /identity/v3/users/1f5dea6992a4447085d8377492272c61 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:25.627059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2935fd2-f277-4c03-9f05-34c0827b689f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:25.722816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5daebd-a765-4b61-b598-db22b1a2e5b3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:25.725781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2935fd2-f277-4c03-9f05-34c0827b689f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:25.757642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd50d2f-c6cd-4fdf-a3ba-4b6e06318e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:25.758316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd50d2f-c6cd-4fdf-a3ba-4b6e06318e2b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.758604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd50d2f-c6cd-4fdf-a3ba-4b6e06318e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.759084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00fc38-239d-44e3-b6b9-95d025ebe909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:25.759194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd50d2f-c6cd-4fdf-a3ba-4b6e06318e2b None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.759721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00fc38-239d-44e3-b6b9-95d025ebe909 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.759914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd50d2f-c6cd-4fdf-a3ba-4b6e06318e2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:25.759997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00fc38-239d-44e3-b6b9-95d025ebe909 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.760225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd50d2f-c6cd-4fdf-a3ba-4b6e06318e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:25.760312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00fc38-239d-44e3-b6b9-95d025ebe909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.761630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd50d2f-c6cd-4fdf-a3ba-4b6e06318e2b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:25.764011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:25.776452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 38/80] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:53:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:25.776452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd50d2f-c6cd-4fdf-a3ba-4b6e06318e2b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:25.821411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:25.842861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00fc38-239d-44e3-b6b9-95d025ebe909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:25.844333 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00fc38-239d-44e3-b6b9-95d025ebe909 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:25.882166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd50d2f-c6cd-4fdf-a3ba-4b6e06318e2b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:25.915690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78159a3-4586-4d18-b819-9e80c1087ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:25.916367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78159a3-4586-4d18-b819-9e80c1087ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:25.916652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78159a3-4586-4d18-b819-9e80c1087ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:25.916934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78159a3-4586-4d18-b819-9e80c1087ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:25.917677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78159a3-4586-4d18-b819-9e80c1087ed7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:25.917987 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78159a3-4586-4d18-b819-9e80c1087ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:25.919960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78159a3-4586-4d18-b819-9e80c1087ed7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:25.928136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 39/81] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:25.928938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78159a3-4586-4d18-b819-9e80c1087ed7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:25.946193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 43/82] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:25.947058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00fc38-239d-44e3-b6b9-95d025ebe909 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:25.987165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:26.026308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:26.027764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78159a3-4586-4d18-b819-9e80c1087ed7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:26.045564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00fc38-239d-44e3-b6b9-95d025ebe909 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:26.060647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d12f5b-69f9-4ec1-99f3-7d70d441f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:26.061297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d12f5b-69f9-4ec1-99f3-7d70d441f6dd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:26.061585 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d12f5b-69f9-4ec1-99f3-7d70d441f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:26.061864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d12f5b-69f9-4ec1-99f3-7d70d441f6dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:26.078403 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd060-9882-4385-9e6a-d7efa9b323f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:26.079159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd060-9882-4385-9e6a-d7efa9b323f4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:26.079447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd060-9882-4385-9e6a-d7efa9b323f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:26.079726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd060-9882-4385-9e6a-d7efa9b323f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:26.080894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fd060-9882-4385-9e6a-d7efa9b323f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:26.082351 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fd060-9882-4385-9e6a-d7efa9b323f4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:26.084069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 44/83] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:26.084743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd060-9882-4385-9e6a-d7efa9b323f4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:26.132045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d12f5b-69f9-4ec1-99f3-7d70d441f6dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:26.133512 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d12f5b-69f9-4ec1-99f3-7d70d441f6dd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:26.187526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd060-9882-4385-9e6a-d7efa9b323f4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:26.191877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:26.221082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe7d7d-faa6-42a1-afed-bf5cbb308a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:26.221951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe7d7d-faa6-42a1-afed-bf5cbb308a7a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:26.222237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe7d7d-faa6-42a1-afed-bf5cbb308a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:26.222515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe7d7d-faa6-42a1-afed-bf5cbb308a7a None admin] PATH_INFO: `/v3/users/0cf3f752e71f49dda8072b132321a74f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:26.223741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe7d7d-faa6-42a1-afed-bf5cbb308a7a None admin] RBAC: Authorizing `identity:get_user(user_id=0cf3f752e71f49dda8072b132321a74f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:26.225194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe7d7d-faa6-42a1-afed-bf5cbb308a7a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:26.226847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 45/84] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:26 2022] GET /identity/v3/users/0cf3f752e71f49dda8072b132321a74f => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:26.227600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe7d7d-faa6-42a1-afed-bf5cbb308a7a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:26.233497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 40/85] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:26.234330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d12f5b-69f9-4ec1-99f3-7d70d441f6dd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:26.245763 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:26.327375 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe7d7d-faa6-42a1-afed-bf5cbb308a7a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:26.332618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d12f5b-69f9-4ec1-99f3-7d70d441f6dd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:26.360136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adc142-d72b-45e1-816c-d03252f89923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:26.360999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adc142-d72b-45e1-816c-d03252f89923 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:26.361279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adc142-d72b-45e1-816c-d03252f89923 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:26.361560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adc142-d72b-45e1-816c-d03252f89923 None admin] PATH_INFO: `/v3/users/0cf3f752e71f49dda8072b132321a74f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:26.362763 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adc142-d72b-45e1-816c-d03252f89923 None admin] RBAC: Authorizing `identity:get_user(user_id=0cf3f752e71f49dda8072b132321a74f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:26.364212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adc142-d72b-45e1-816c-d03252f89923 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:26.365822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 46/86] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:26 2022] GET /identity/v3/users/0cf3f752e71f49dda8072b132321a74f => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:26.366005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1c963-460a-487f-98ce-88879603fc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:26.366557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adc142-d72b-45e1-816c-d03252f89923 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:26.366852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1c963-460a-487f-98ce-88879603fc07 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:26.367144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1c963-460a-487f-98ce-88879603fc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:26.367430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1c963-460a-487f-98ce-88879603fc07 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:26.371014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1c963-460a-487f-98ce-88879603fc07 None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:26.373118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1c963-460a-487f-98ce-88879603fc07 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:26.374933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 41/87] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:26 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:26.375527 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1c963-460a-487f-98ce-88879603fc07 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:26.405963 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:26.455929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:26.471958 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adc142-d72b-45e1-816c-d03252f89923 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:26.477976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1c963-460a-487f-98ce-88879603fc07 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:26.504743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23907c-40ba-4040-a191-5e8f629af0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:26.505409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23907c-40ba-4040-a191-5e8f629af0ee None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:26.505698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23907c-40ba-4040-a191-5e8f629af0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:26.505976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23907c-40ba-4040-a191-5e8f629af0ee None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:26.506686 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23907c-40ba-4040-a191-5e8f629af0ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:26.509951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23907c-40ba-4040-a191-5e8f629af0ee None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:26.513378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55b7e8-a3c5-4c36-b17f-9fd6bff1dea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:26.514030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55b7e8-a3c5-4c36-b17f-9fd6bff1dea8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:26.514313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55b7e8-a3c5-4c36-b17f-9fd6bff1dea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:26.514586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55b7e8-a3c5-4c36-b17f-9fd6bff1dea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:26.546730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 47/88] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:53:26 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:26.546730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23907c-40ba-4040-a191-5e8f629af0ee None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:26.589210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55b7e8-a3c5-4c36-b17f-9fd6bff1dea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:26.590760 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55b7e8-a3c5-4c36-b17f-9fd6bff1dea8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:26.628866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:26.674376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23907c-40ba-4040-a191-5e8f629af0ee None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:26.713892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 42/89] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:26.715003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55b7e8-a3c5-4c36-b17f-9fd6bff1dea8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:26.723237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c5c7b-282b-4c25-9022-8d512d5df986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:26.724133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c5c7b-282b-4c25-9022-8d512d5df986 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:26.724420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c5c7b-282b-4c25-9022-8d512d5df986 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:26.724700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c5c7b-282b-4c25-9022-8d512d5df986 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:26.725914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c5c7b-282b-4c25-9022-8d512d5df986 None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:26.727408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c5c7b-282b-4c25-9022-8d512d5df986 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:26.729256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 48/90] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:26 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:26.729875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c5c7b-282b-4c25-9022-8d512d5df986 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:26.743139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:26.834226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55b7e8-a3c5-4c36-b17f-9fd6bff1dea8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:26.860279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c5c7b-282b-4c25-9022-8d512d5df986 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:26.864899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:26.874534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12406a2-4db0-4591-82d2-4fe146a09d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:26.875658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12406a2-4db0-4591-82d2-4fe146a09d82 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:26.875978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12406a2-4db0-4591-82d2-4fe146a09d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:26.876284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12406a2-4db0-4591-82d2-4fe146a09d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:26.900250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda69e86-69f0-4847-841c-38019e1a4a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:26.900916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda69e86-69f0-4847-841c-38019e1a4a04 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:26.901206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda69e86-69f0-4847-841c-38019e1a4a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:26.901489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda69e86-69f0-4847-841c-38019e1a4a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:26.902331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda69e86-69f0-4847-841c-38019e1a4a04 None admin] RBAC: Adding query filter params (role.id=bce93d0b549349079c3292eb120d54c1, scope.project.id=784d0612b566498b8205942e82777be5, user.id=0cf3f752e71f49dda8072b132321a74f) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:26.902649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda69e86-69f0-4847-841c-38019e1a4a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:26.904700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda69e86-69f0-4847-841c-38019e1a4a04 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:26.911744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 49/91] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:26 2022] GET /identity/v3/role_assignments?user.id=0cf3f752e71f49dda8072b132321a74f&scope.project.id=784d0612b566498b8205942e82777be5&role.id=bce93d0b549349079c3292eb120d54c1 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:26.912311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda69e86-69f0-4847-841c-38019e1a4a04 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:26.966146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12406a2-4db0-4591-82d2-4fe146a09d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:26.968021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12406a2-4db0-4591-82d2-4fe146a09d82 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:26.995719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:27.024031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda69e86-69f0-4847-841c-38019e1a4a04 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:27.062009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a45405-7a91-4aa3-a4e9-f7c2e3d1238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:27.062933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45405-7a91-4aa3-a4e9-f7c2e3d1238b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:27.063225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45405-7a91-4aa3-a4e9-f7c2e3d1238b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:27.063510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45405-7a91-4aa3-a4e9-f7c2e3d1238b None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:27.064831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a45405-7a91-4aa3-a4e9-f7c2e3d1238b None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:27.066347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a45405-7a91-4aa3-a4e9-f7c2e3d1238b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:27.068549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 50/92] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:26 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:27.069362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a45405-7a91-4aa3-a4e9-f7c2e3d1238b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:27.087999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 43/93] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:27.089361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12406a2-4db0-4591-82d2-4fe146a09d82 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:27.121798 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:27.185879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a45405-7a91-4aa3-a4e9-f7c2e3d1238b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:27.207420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12406a2-4db0-4591-82d2-4fe146a09d82 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:27.222926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164725d0-1075-4595-8b83-b780557fa791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:27.223602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164725d0-1075-4595-8b83-b780557fa791 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:27.223892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164725d0-1075-4595-8b83-b780557fa791 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:27.224172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164725d0-1075-4595-8b83-b780557fa791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:27.225028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164725d0-1075-4595-8b83-b780557fa791 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=784d0612b566498b8205942e82777be5, user.id=1f5dea6992a4447085d8377492272c61) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:27.225345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164725d0-1075-4595-8b83-b780557fa791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:27.226841 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164725d0-1075-4595-8b83-b780557fa791 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:27.232952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 51/94] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:27 2022] GET /identity/v3/role_assignments?user.id=1f5dea6992a4447085d8377492272c61&scope.project.id=784d0612b566498b8205942e82777be5&role.id=af8084c48e3c40298e26d44d6d14595a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:27.233865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164725d0-1075-4595-8b83-b780557fa791 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:27.244136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:27.260541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c35d12-b076-40f4-8e6e-076a68e6a472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:27.261605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c35d12-b076-40f4-8e6e-076a68e6a472 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:27.262119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c35d12-b076-40f4-8e6e-076a68e6a472 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:27.263174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c35d12-b076-40f4-8e6e-076a68e6a472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:27.264389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c35d12-b076-40f4-8e6e-076a68e6a472 None admin] RBAC: Adding query filter params (role.id=66b09c60197a4a1fb2cca5402bb83375, scope.project.id=784d0612b566498b8205942e82777be5, user.id=0cf3f752e71f49dda8072b132321a74f) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:27.264995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c35d12-b076-40f4-8e6e-076a68e6a472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:27.266960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c35d12-b076-40f4-8e6e-076a68e6a472 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:27.281823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 44/95] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:27 2022] GET /identity/v3/role_assignments?user.id=0cf3f752e71f49dda8072b132321a74f&scope.project.id=784d0612b566498b8205942e82777be5&role.id=66b09c60197a4a1fb2cca5402bb83375 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:27.360596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164725d0-1075-4595-8b83-b780557fa791 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:27.401479 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a20f50-8065-4e56-99a7-b68e3161d4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:27.402381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a20f50-8065-4e56-99a7-b68e3161d4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:27.402672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a20f50-8065-4e56-99a7-b68e3161d4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:27.403007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a20f50-8065-4e56-99a7-b68e3161d4b2 None admin] PATH_INFO: `/v3/projects/6bf3d5cfa2794b7f81d7d0e41e31ff4e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:27.404436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a20f50-8065-4e56-99a7-b68e3161d4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=6bf3d5cfa2794b7f81d7d0e41e31ff4e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:27.405948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a20f50-8065-4e56-99a7-b68e3161d4b2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:27.407818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 52/96] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:27 2022] GET /identity/v3/projects/6bf3d5cfa2794b7f81d7d0e41e31ff4e => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:27.417806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c35d12-b076-40f4-8e6e-076a68e6a472 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:27.523084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:27.532866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c35d12-b076-40f4-8e6e-076a68e6a472 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:27.570916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3d876-572a-41f6-8bf7-953be47ea01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:27.571608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d876-572a-41f6-8bf7-953be47ea01d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:27.571899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d876-572a-41f6-8bf7-953be47ea01d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:27.572184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d876-572a-41f6-8bf7-953be47ea01d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:27.573050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3d876-572a-41f6-8bf7-953be47ea01d None admin] RBAC: Adding query filter params (role.id=bce93d0b549349079c3292eb120d54c1, scope.project.id=6bf3d5cfa2794b7f81d7d0e41e31ff4e, user.id=0cf3f752e71f49dda8072b132321a74f) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:27.573368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3d876-572a-41f6-8bf7-953be47ea01d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:27.574887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3d876-572a-41f6-8bf7-953be47ea01d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:27.581418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 45/97] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:27 2022] GET /identity/v3/role_assignments?user.id=0cf3f752e71f49dda8072b132321a74f&scope.project.id=6bf3d5cfa2794b7f81d7d0e41e31ff4e&role.id=bce93d0b549349079c3292eb120d54c1 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:30.218685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c94c6-bff8-4080-9591-c8805299d7f3 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.219265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c94c6-bff8-4080-9591-c8805299d7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.219265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c94c6-bff8-4080-9591-c8805299d7f3 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.220913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 53/98] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:30.226508 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7bfbc-da7e-46b5-b5d8-dd207aeb0f2a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.227436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7bfbc-da7e-46b5-b5d8-dd207aeb0f2a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.227924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7bfbc-da7e-46b5-b5d8-dd207aeb0f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.230396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b811f-691e-4609-bc73-89293c2ba1d8 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.230686 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b811f-691e-4609-bc73-89293c2ba1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.230990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b811f-691e-4609-bc73-89293c2ba1d8 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.233280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 54/99] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:30.239033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e6c68-a564-41d3-82d6-cac282041234 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.239323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e6c68-a564-41d3-82d6-cac282041234 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.239601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e6c68-a564-41d3-82d6-cac282041234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.257701 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-89b7bfbc-da7e-46b5-b5d8-dd207aeb0f2a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:30.259568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-89b7bfbc-da7e-46b5-b5d8-dd207aeb0f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:30.271856 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-dc1e6c68-a564-41d3-82d6-cac282041234 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:30.273073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dc1e6c68-a564-41d3-82d6-cac282041234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:30.384664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 46/100] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:30.385901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf904a9-7727-4c5c-81d6-3d88e365b401 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.386262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf904a9-7727-4c5c-81d6-3d88e365b401 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.386547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf904a9-7727-4c5c-81d6-3d88e365b401 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.392560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 47/101] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:30.394109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c1d47-1dbd-4a6a-9eed-10f83b03d16a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.394466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c1d47-1dbd-4a6a-9eed-10f83b03d16a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.394899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c1d47-1dbd-4a6a-9eed-10f83b03d16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.412404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-216c1d47-1dbd-4a6a-9eed-10f83b03d16a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:30.413584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-216c1d47-1dbd-4a6a-9eed-10f83b03d16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:30.473251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 55/102] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:30.474046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e6c68-a564-41d3-82d6-cac282041234 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:30.490101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:30.492431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 48/103] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:30.514818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c1d47-1dbd-4a6a-9eed-10f83b03d16a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:30.547244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:30.638831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e6c68-a564-41d3-82d6-cac282041234 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:30.645454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c1d47-1dbd-4a6a-9eed-10f83b03d16a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:30.673421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b90c6c-dab2-4102-b9a8-86abc0862b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:30.674220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b90c6c-dab2-4102-b9a8-86abc0862b91 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.674504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b90c6c-dab2-4102-b9a8-86abc0862b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.674822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b90c6c-dab2-4102-b9a8-86abc0862b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.684045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015814f9-75a8-4f60-b777-142825ed1212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:30.686075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b90c6c-dab2-4102-b9a8-86abc0862b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:30.686198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015814f9-75a8-4f60-b777-142825ed1212 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.686375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015814f9-75a8-4f60-b777-142825ed1212 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.686635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015814f9-75a8-4f60-b777-142825ed1212 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-79b90c6c-dab2-4102-b9a8-86abc0862b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:30.699009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:30.700022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:30.700851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:30.701476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015814f9-75a8-4f60-b777-142825ed1212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:30.701549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 56/104] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:53:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:30.705992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b90c6c-dab2-4102-b9a8-86abc0862b91 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-015814f9-75a8-4f60-b777-142825ed1212 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:30.707893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:30.708743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:30.709526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 49/105] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:30.710685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5929e-0f23-4f0e-8e28-900cfa3e5232 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.711011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5929e-0f23-4f0e-8e28-900cfa3e5232 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.711288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5929e-0f23-4f0e-8e28-900cfa3e5232 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.712636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 50/106] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:30.717847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5929e-0f23-4f0e-8e28-900cfa3e5232 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:30.779244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:30.799437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:30.818673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b90c6c-dab2-4102-b9a8-86abc0862b91 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:30.823696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5929e-0f23-4f0e-8e28-900cfa3e5232 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:30.851456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec34e-1a84-429e-b11f-84fd7425e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:30.852240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec34e-1a84-429e-b11f-84fd7425e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.852521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec34e-1a84-429e-b11f-84fd7425e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.852803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec34e-1a84-429e-b11f-84fd7425e1a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.853960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eec34e-1a84-429e-b11f-84fd7425e1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:30.855436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eec34e-1a84-429e-b11f-84fd7425e1a3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:30.857242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 57/107] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:30.857502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7694dd-1eab-4607-9932-72c36dae3880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:30.857850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec34e-1a84-429e-b11f-84fd7425e1a3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:30.858182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7694dd-1eab-4607-9932-72c36dae3880 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.858474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7694dd-1eab-4607-9932-72c36dae3880 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.858785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7694dd-1eab-4607-9932-72c36dae3880 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.859547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7694dd-1eab-4607-9932-72c36dae3880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:30.859866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7694dd-1eab-4607-9932-72c36dae3880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:30.861251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7694dd-1eab-4607-9932-72c36dae3880 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:30.869964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 51/108] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:30.871206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42f812-9291-46a8-8d14-4690e824670f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.871502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42f812-9291-46a8-8d14-4690e824670f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.872308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42f812-9291-46a8-8d14-4690e824670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.888949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0f42f812-9291-46a8-8d14-4690e824670f None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:30.890141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0f42f812-9291-46a8-8d14-4690e824670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:30.956308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 52/109] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:30.957606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d293792-183e-497a-a532-4365d7859681 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.957899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d293792-183e-497a-a532-4365d7859681 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.958180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d293792-183e-497a-a532-4365d7859681 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.959650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 53/110] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:30.960555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d97871-da59-4adb-bb3d-fdfe0121ee81 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:30.960840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d97871-da59-4adb-bb3d-fdfe0121ee81 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:30.961121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d97871-da59-4adb-bb3d-fdfe0121ee81 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:30.962340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 54/111] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:30.966376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d97871-da59-4adb-bb3d-fdfe0121ee81 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:30.971111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec34e-1a84-429e-b11f-84fd7425e1a3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.000199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:31.005300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e387-373b-4a90-b39d-8115b0723f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.005968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e387-373b-4a90-b39d-8115b0723f07 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.006257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e387-373b-4a90-b39d-8115b0723f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.006541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e387-373b-4a90-b39d-8115b0723f07 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.007323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9e387-373b-4a90-b39d-8115b0723f07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:31.007635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9e387-373b-4a90-b39d-8115b0723f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:31.009280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9e387-373b-4a90-b39d-8115b0723f07 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:31.022572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 58/112] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:31.022572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e387-373b-4a90-b39d-8115b0723f07 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:31.040171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:31.075641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d97871-da59-4adb-bb3d-fdfe0121ee81 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.110195 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c5c9b-ee7b-4327-8e01-a3be56a5a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.110881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c5c9b-ee7b-4327-8e01-a3be56a5a52f None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.111165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c5c9b-ee7b-4327-8e01-a3be56a5a52f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.111441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c5c9b-ee7b-4327-8e01-a3be56a5a52f None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.112142 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c5c9b-ee7b-4327-8e01-a3be56a5a52f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:31.113595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c5c9b-ee7b-4327-8e01-a3be56a5a52f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:31.123670 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e387-373b-4a90-b39d-8115b0723f07 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.138253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 55/113] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:53:30 2022] POST /identity/v3/projects => generated 302 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:31.139510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4387-0a30-40ce-a68e-2544fb789435 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.139801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4387-0a30-40ce-a68e-2544fb789435 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.140079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4387-0a30-40ce-a68e-2544fb789435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.158453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4c8e4387-0a30-40ce-a68e-2544fb789435 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:31.159767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4c8e4387-0a30-40ce-a68e-2544fb789435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:31.172130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd779-6bb2-49b7-b9a0-c7d80329434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.173409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd779-6bb2-49b7-b9a0-c7d80329434a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.173923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd779-6bb2-49b7-b9a0-c7d80329434a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.174432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd779-6bb2-49b7-b9a0-c7d80329434a None admin] PATH_INFO: `/v3/users/1f5dea6992a4447085d8377492272c61` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.176285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd779-6bb2-49b7-b9a0-c7d80329434a None admin] RBAC: Authorizing `identity:get_user(user_id=1f5dea6992a4447085d8377492272c61)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:31.178602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd779-6bb2-49b7-b9a0-c7d80329434a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:31.180428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 59/114] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:31 2022] GET /identity/v3/users/1f5dea6992a4447085d8377492272c61 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:31.186489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90d43a-8f21-4e04-b489-e537578304b8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.186489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90d43a-8f21-4e04-b489-e537578304b8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.186489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90d43a-8f21-4e04-b489-e537578304b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.201545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-de90d43a-8f21-4e04-b489-e537578304b8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:31.202862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-de90d43a-8f21-4e04-b489-e537578304b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:31.245706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 56/115] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:31.251895 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e4387-0a30-40ce-a68e-2544fb789435 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:31.270682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:31.286275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 60/116] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:31.287478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90d43a-8f21-4e04-b489-e537578304b8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:31.325530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:31.390568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e4387-0a30-40ce-a68e-2544fb789435 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.409928 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90d43a-8f21-4e04-b489-e537578304b8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.427858 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9aab-11a5-45ba-95d7-ae3fb3c24a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.428783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9aab-11a5-45ba-95d7-ae3fb3c24a97 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.429140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9aab-11a5-45ba-95d7-ae3fb3c24a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.429489 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9aab-11a5-45ba-95d7-ae3fb3c24a97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.441638 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b9aab-11a5-45ba-95d7-ae3fb3c24a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:31.447550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ca9fa-1d34-4488-8b1e-804f94730d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.448506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca9fa-1d34-4488-8b1e-804f94730d76 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.448878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca9fa-1d34-4488-8b1e-804f94730d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.449225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca9fa-1d34-4488-8b1e-804f94730d76 None admin] PATH_INFO: `/v3/users/aba599d1ea884a348b5721b8457305fb` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-473b9aab-11a5-45ba-95d7-ae3fb3c24a97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:31.449904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:31.456129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 57/117] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:53:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:31.456974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9aab-11a5-45ba-95d7-ae3fb3c24a97 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:31.464957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ca9fa-1d34-4488-8b1e-804f94730d76 None admin] RBAC: Authorizing `identity:get_user(user_id=aba599d1ea884a348b5721b8457305fb)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:31.467160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ca9fa-1d34-4488-8b1e-804f94730d76 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:31.473205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 61/118] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:31 2022] GET /identity/v3/users/aba599d1ea884a348b5721b8457305fb => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:31.473205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ca9fa-1d34-4488-8b1e-804f94730d76 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:31.526370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:31.577377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9aab-11a5-45ba-95d7-ae3fb3c24a97 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.580205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ca9fa-1d34-4488-8b1e-804f94730d76 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.587949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:31.617125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca141eba-2248-45d0-b7d3-6976c7eca997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.618112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca141eba-2248-45d0-b7d3-6976c7eca997 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.618470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca141eba-2248-45d0-b7d3-6976c7eca997 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.618561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36778afc-8cf1-42d1-b1c0-1cc53ca77534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.618872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca141eba-2248-45d0-b7d3-6976c7eca997 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.619585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36778afc-8cf1-42d1-b1c0-1cc53ca77534 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.619876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36778afc-8cf1-42d1-b1c0-1cc53ca77534 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.620154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36778afc-8cf1-42d1-b1c0-1cc53ca77534 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.620280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca141eba-2248-45d0-b7d3-6976c7eca997 None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:31.621967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca141eba-2248-45d0-b7d3-6976c7eca997 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:31.623740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 58/119] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:31 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:31.624519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca141eba-2248-45d0-b7d3-6976c7eca997 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:31.636681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36778afc-8cf1-42d1-b1c0-1cc53ca77534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-36778afc-8cf1-42d1-b1c0-1cc53ca77534 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:31.644592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:31.645658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:31.646471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 62/120] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:31.647159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36778afc-8cf1-42d1-b1c0-1cc53ca77534 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:31.741620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca141eba-2248-45d0-b7d3-6976c7eca997 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.761412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36778afc-8cf1-42d1-b1c0-1cc53ca77534 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.773207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:31.780194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819576a4-7384-4d01-8d8e-bae3fd1ae0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.781498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819576a4-7384-4d01-8d8e-bae3fd1ae0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.782380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819576a4-7384-4d01-8d8e-bae3fd1ae0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.782892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819576a4-7384-4d01-8d8e-bae3fd1ae0c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.797207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819576a4-7384-4d01-8d8e-bae3fd1ae0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:31.799494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2f118-e413-46e4-ac92-7672043cb481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.800175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2f118-e413-46e4-ac92-7672043cb481 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.800465 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2f118-e413-46e4-ac92-7672043cb481 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.800744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2f118-e413-46e4-ac92-7672043cb481 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.801549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2f118-e413-46e4-ac92-7672043cb481 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:31.801865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2f118-e413-46e4-ac92-7672043cb481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:31.803285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2f118-e413-46e4-ac92-7672043cb481 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-819576a4-7384-4d01-8d8e-bae3fd1ae0c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:31.804893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:31.805737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:31.806540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 59/121] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:31.808164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819576a4-7384-4d01-8d8e-bae3fd1ae0c3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:31.817185 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 63/122] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:53:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:31.822246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2f118-e413-46e4-ac92-7672043cb481 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:31.849941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:31.918112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819576a4-7384-4d01-8d8e-bae3fd1ae0c3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.928708 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2f118-e413-46e4-ac92-7672043cb481 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:31.955873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93242b85-3e72-4be4-995e-395809de5445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.956881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242b85-3e72-4be4-995e-395809de5445 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.957174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242b85-3e72-4be4-995e-395809de5445 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.957452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242b85-3e72-4be4-995e-395809de5445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.962257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a06c1-66b0-42e7-98f4-7a9081b86558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:31.963172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a06c1-66b0-42e7-98f4-7a9081b86558 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:31.963458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a06c1-66b0-42e7-98f4-7a9081b86558 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:31.963733 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a06c1-66b0-42e7-98f4-7a9081b86558 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5/users/1f5dea6992a4447085d8377492272c61/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:31.965805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a06c1-66b0-42e7-98f4-7a9081b86558 None admin] RBAC: Authorizing `identity:create_grant(project_id=784d0612b566498b8205942e82777be5, user_id=1f5dea6992a4447085d8377492272c61, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:31.967674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a06c1-66b0-42e7-98f4-7a9081b86558 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:31.990722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 64/123] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:53:31 2022] PUT /identity/v3/projects/784d0612b566498b8205942e82777be5/users/1f5dea6992a4447085d8377492272c61/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:53:31.990722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a06c1-66b0-42e7-98f4-7a9081b86558 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:32.031922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:32.056913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93242b85-3e72-4be4-995e-395809de5445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:32.058449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93242b85-3e72-4be4-995e-395809de5445 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:32.116576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:32.125337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a06c1-66b0-42e7-98f4-7a9081b86558 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:32.178226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118b8df-c581-46eb-922c-4b110bf450cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:32.178949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118b8df-c581-46eb-922c-4b110bf450cf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:32.179293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118b8df-c581-46eb-922c-4b110bf450cf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:32.179576 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118b8df-c581-46eb-922c-4b110bf450cf None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:32.180953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118b8df-c581-46eb-922c-4b110bf450cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:32.181270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118b8df-c581-46eb-922c-4b110bf450cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:32.185234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118b8df-c581-46eb-922c-4b110bf450cf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:32.195638 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 60/124] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:32.197290 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 65/125] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:32.197290 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118b8df-c581-46eb-922c-4b110bf450cf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:32.198086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93242b85-3e72-4be4-995e-395809de5445 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:32.322160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93242b85-3e72-4be4-995e-395809de5445 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:32.337715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:32.348253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118b8df-c581-46eb-922c-4b110bf450cf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:32.373673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac08be7-df00-42f3-9e7a-66d0c3d844f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:32.374279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac08be7-df00-42f3-9e7a-66d0c3d844f6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:32.374570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac08be7-df00-42f3-9e7a-66d0c3d844f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:32.374881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac08be7-df00-42f3-9e7a-66d0c3d844f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:32.376200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac08be7-df00-42f3-9e7a-66d0c3d844f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:32.376519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac08be7-df00-42f3-9e7a-66d0c3d844f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:32.378532 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac08be7-df00-42f3-9e7a-66d0c3d844f6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:32.386213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:32.390671 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0cbac-b88d-4056-9deb-8b5cf4d466d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:32.391999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 61/126] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:32.392706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac08be7-df00-42f3-9e7a-66d0c3d844f6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:32.393312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0cbac-b88d-4056-9deb-8b5cf4d466d1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:32.394139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0cbac-b88d-4056-9deb-8b5cf4d466d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:32.394882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0cbac-b88d-4056-9deb-8b5cf4d466d1 None admin] PATH_INFO: `/v3/users/0cf3f752e71f49dda8072b132321a74f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:32.398340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0cbac-b88d-4056-9deb-8b5cf4d466d1 None admin] RBAC: Authorizing `identity:get_user(user_id=0cf3f752e71f49dda8072b132321a74f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:32.400066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0cbac-b88d-4056-9deb-8b5cf4d466d1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:32.401967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 66/127] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:32 2022] GET /identity/v3/users/0cf3f752e71f49dda8072b132321a74f => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:32.403102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0cbac-b88d-4056-9deb-8b5cf4d466d1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:32.514321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac08be7-df00-42f3-9e7a-66d0c3d844f6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:32.528864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0cbac-b88d-4056-9deb-8b5cf4d466d1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:32.553777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db202227-b08a-49b0-81fd-141eff56980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:32.555097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db202227-b08a-49b0-81fd-141eff56980e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:32.555585 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db202227-b08a-49b0-81fd-141eff56980e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:32.556092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db202227-b08a-49b0-81fd-141eff56980e None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:32.557679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db202227-b08a-49b0-81fd-141eff56980e None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:32.559728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db202227-b08a-49b0-81fd-141eff56980e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:32.561894 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 62/128] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:32 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:32.563070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db202227-b08a-49b0-81fd-141eff56980e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:32.565288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef389a-5d55-4cdf-8c5d-26609ebc3011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:32.566280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef389a-5d55-4cdf-8c5d-26609ebc3011 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:32.566574 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef389a-5d55-4cdf-8c5d-26609ebc3011 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:32.566950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef389a-5d55-4cdf-8c5d-26609ebc3011 None admin] PATH_INFO: `/v3/users/0cf3f752e71f49dda8072b132321a74f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:32.568377 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef389a-5d55-4cdf-8c5d-26609ebc3011 None admin] RBAC: Authorizing `identity:get_user(user_id=0cf3f752e71f49dda8072b132321a74f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:32.569675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef389a-5d55-4cdf-8c5d-26609ebc3011 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:32.571338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 67/129] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:32 2022] GET /identity/v3/users/0cf3f752e71f49dda8072b132321a74f => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:32.572094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef389a-5d55-4cdf-8c5d-26609ebc3011 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:32.613200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:32.640776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:32.678989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db202227-b08a-49b0-81fd-141eff56980e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:32.705549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef389a-5d55-4cdf-8c5d-26609ebc3011 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:32.717938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e2937-25dd-4067-87e4-5b7e4357a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:32.719257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e2937-25dd-4067-87e4-5b7e4357a6bb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:32.719844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e2937-25dd-4067-87e4-5b7e4357a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:32.720385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e2937-25dd-4067-87e4-5b7e4357a6bb None admin] PATH_INFO: `/v3/users/0cf3f752e71f49dda8072b132321a74f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:32.721805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e2937-25dd-4067-87e4-5b7e4357a6bb None admin] RBAC: Authorizing `identity:get_user(user_id=0cf3f752e71f49dda8072b132321a74f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:32.723653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e2937-25dd-4067-87e4-5b7e4357a6bb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:32.725927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 63/130] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:32 2022] GET /identity/v3/users/0cf3f752e71f49dda8072b132321a74f => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:32.727012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e2937-25dd-4067-87e4-5b7e4357a6bb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:32.756053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8454929-a05b-4555-a940-4f372712136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:32.757874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8454929-a05b-4555-a940-4f372712136d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:32.758381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8454929-a05b-4555-a940-4f372712136d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:32.759312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8454929-a05b-4555-a940-4f372712136d None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:32.761036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8454929-a05b-4555-a940-4f372712136d None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:32.762763 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8454929-a05b-4555-a940-4f372712136d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:32.765432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 68/131] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:32 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:32.766556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8454929-a05b-4555-a940-4f372712136d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:32.861287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e2937-25dd-4067-87e4-5b7e4357a6bb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:32.898745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbda275-ef2e-4908-b690-860f0e5ed7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:32.899766 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbda275-ef2e-4908-b690-860f0e5ed7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:32.900307 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbda275-ef2e-4908-b690-860f0e5ed7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:32.900809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbda275-ef2e-4908-b690-860f0e5ed7c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:32.901897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbda275-ef2e-4908-b690-860f0e5ed7c6 None admin] RBAC: Adding query filter params (role.id=ddd16047c21a4707886ce223206a83de, scope.project.id=784d0612b566498b8205942e82777be5, user.id=aba599d1ea884a348b5721b8457305fb) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:32.902739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbda275-ef2e-4908-b690-860f0e5ed7c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:32.905210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbda275-ef2e-4908-b690-860f0e5ed7c6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:32.908924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:32.909855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:32.915466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8454929-a05b-4555-a940-4f372712136d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:32.923369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 64/132] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:32 2022] GET /identity/v3/role_assignments?user.id=aba599d1ea884a348b5721b8457305fb&scope.project.id=784d0612b566498b8205942e82777be5&role.id=ddd16047c21a4707886ce223206a83de => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:32.924782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbda275-ef2e-4908-b690-860f0e5ed7c6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:32.969902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1df56-9e03-420f-8f7e-b143a247a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:32.972293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1df56-9e03-420f-8f7e-b143a247a2ec None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:32.976324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1df56-9e03-420f-8f7e-b143a247a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:32.976819 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1df56-9e03-420f-8f7e-b143a247a2ec None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:32.978403 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1df56-9e03-420f-8f7e-b143a247a2ec None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:32.983064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1df56-9e03-420f-8f7e-b143a247a2ec None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:32.985312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 69/133] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:32 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:32.995081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1df56-9e03-420f-8f7e-b143a247a2ec None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:33.183067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1df56-9e03-420f-8f7e-b143a247a2ec None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:33.211379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbda275-ef2e-4908-b690-860f0e5ed7c6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:33.249983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62f930-0b6b-469d-80e5-3b2b1a0edecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:33.251479 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f930-0b6b-469d-80e5-3b2b1a0edecb None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:33.251914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f930-0b6b-469d-80e5-3b2b1a0edecb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:33.252857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f930-0b6b-469d-80e5-3b2b1a0edecb None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5/users/0cf3f752e71f49dda8072b132321a74f/roles/66b09c60197a4a1fb2cca5402bb83375` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:33.256565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62f930-0b6b-469d-80e5-3b2b1a0edecb None admin] RBAC: Authorizing `identity:create_grant(project_id=784d0612b566498b8205942e82777be5, user_id=0cf3f752e71f49dda8072b132321a74f, role_id=66b09c60197a4a1fb2cca5402bb83375)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:33.258657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62f930-0b6b-469d-80e5-3b2b1a0edecb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:33.261278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c56f7f-977d-42a7-8aa4-db3558c37f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:33.262436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c56f7f-977d-42a7-8aa4-db3558c37f39 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:33.262436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c56f7f-977d-42a7-8aa4-db3558c37f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:33.262863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c56f7f-977d-42a7-8aa4-db3558c37f39 None admin] PATH_INFO: `/v3/projects/6bf3d5cfa2794b7f81d7d0e41e31ff4e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:33.264801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c56f7f-977d-42a7-8aa4-db3558c37f39 None admin] RBAC: Authorizing `identity:get_project(project_id=6bf3d5cfa2794b7f81d7d0e41e31ff4e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:33.272146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c56f7f-977d-42a7-8aa4-db3558c37f39 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:33.272146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 65/134] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:32 2022] GET /identity/v3/projects/6bf3d5cfa2794b7f81d7d0e41e31ff4e => generated 312 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:33.272146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c56f7f-977d-42a7-8aa4-db3558c37f39 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:33.289776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 70/135] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:53:32 2022] PUT /identity/v3/projects/784d0612b566498b8205942e82777be5/users/0cf3f752e71f49dda8072b132321a74f/roles/66b09c60197a4a1fb2cca5402bb83375 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:53:33.291105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62f930-0b6b-469d-80e5-3b2b1a0edecb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:33.361656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:33.416818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:33.479172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62f930-0b6b-469d-80e5-3b2b1a0edecb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:33.486594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c56f7f-977d-42a7-8aa4-db3558c37f39 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:33.530771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89e5f4-888c-4ff6-848d-72da7defe065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:33.532305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89e5f4-888c-4ff6-848d-72da7defe065 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:33.532305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89e5f4-888c-4ff6-848d-72da7defe065 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:33.532782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89e5f4-888c-4ff6-848d-72da7defe065 None admin] PATH_INFO: `/v3/projects/6bf3d5cfa2794b7f81d7d0e41e31ff4e/users/0cf3f752e71f49dda8072b132321a74f/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:33.538616 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89e5f4-888c-4ff6-848d-72da7defe065 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bf3d5cfa2794b7f81d7d0e41e31ff4e, user_id=0cf3f752e71f49dda8072b132321a74f, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:33.542659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89e5f4-888c-4ff6-848d-72da7defe065 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:33.576155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 71/136] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:53:33 2022] PUT /identity/v3/projects/6bf3d5cfa2794b7f81d7d0e41e31ff4e/users/0cf3f752e71f49dda8072b132321a74f/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:53:33.593791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c120b5-b673-404a-9d64-ca665776185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:33.595698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c120b5-b673-404a-9d64-ca665776185d None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:33.596153 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c120b5-b673-404a-9d64-ca665776185d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:33.596582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c120b5-b673-404a-9d64-ca665776185d None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5/users/0cf3f752e71f49dda8072b132321a74f/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:33.599183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c120b5-b673-404a-9d64-ca665776185d None admin] RBAC: Authorizing `identity:create_grant(project_id=784d0612b566498b8205942e82777be5, user_id=0cf3f752e71f49dda8072b132321a74f, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:33.601082 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c120b5-b673-404a-9d64-ca665776185d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:33.623453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 66/137] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:53:33 2022] PUT /identity/v3/projects/784d0612b566498b8205942e82777be5/users/0cf3f752e71f49dda8072b132321a74f/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:53:33.645427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a05e9a-c7d2-43a9-951f-3703f8d7ae28 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:33.645817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a05e9a-c7d2-43a9-951f-3703f8d7ae28 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:33.646130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a05e9a-c7d2-43a9-951f-3703f8d7ae28 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:33.647878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 72/138] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:33.662096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2c6ac-e3f5-4ab3-a830-1bf3fb5f215e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:33.662415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2c6ac-e3f5-4ab3-a830-1bf3fb5f215e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:33.662730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2c6ac-e3f5-4ab3-a830-1bf3fb5f215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:33.685071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-00d2c6ac-e3f5-4ab3-a830-1bf3fb5f215e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:33.686385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-00d2c6ac-e3f5-4ab3-a830-1bf3fb5f215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:33.790523 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 67/139] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:33.845536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a05e9a-c7d2-43a9-951f-3703f8d7ae28 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:33.979033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:34.005156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a05e9a-c7d2-43a9-951f-3703f8d7ae28 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:34.054151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd92f8-cb8d-4071-a211-6f8c8bd853c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:34.054969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd92f8-cb8d-4071-a211-6f8c8bd853c8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:34.055284 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd92f8-cb8d-4071-a211-6f8c8bd853c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:34.055587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd92f8-cb8d-4071-a211-6f8c8bd853c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:34.056890 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd92f8-cb8d-4071-a211-6f8c8bd853c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:34.058511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd92f8-cb8d-4071-a211-6f8c8bd853c8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:34.060775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 73/140] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:34.066578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2c6ac-e3f5-4ab3-a830-1bf3fb5f215e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:34.155060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:34.201686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2c6ac-e3f5-4ab3-a830-1bf3fb5f215e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:34.240038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46576377-cfc1-496d-a898-bd4ed9014604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:34.241061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46576377-cfc1-496d-a898-bd4ed9014604 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:34.241587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46576377-cfc1-496d-a898-bd4ed9014604 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:34.242059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46576377-cfc1-496d-a898-bd4ed9014604 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:34.243012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46576377-cfc1-496d-a898-bd4ed9014604 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:34.244659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46576377-cfc1-496d-a898-bd4ed9014604 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:34.267858 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 68/141] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:53:34 2022] POST /identity/v3/users => generated 283 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:34.939277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489c428-5e9d-454d-baa3-4753cfab7db5 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:34.939805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489c428-5e9d-454d-baa3-4753cfab7db5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:34.939881 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489c428-5e9d-454d-baa3-4753cfab7db5 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:34.941323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 74/142] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:34.955171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0166-3d0c-463e-b703-b74052856124 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:34.955671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0166-3d0c-463e-b703-b74052856124 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:34.955877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0166-3d0c-463e-b703-b74052856124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:34.975929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b27a0166-3d0c-463e-b703-b74052856124 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:34.977253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b27a0166-3d0c-463e-b703-b74052856124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:35.077112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 69/143] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:35.114721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489c428-5e9d-454d-baa3-4753cfab7db5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:35.255577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489c428-5e9d-454d-baa3-4753cfab7db5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:35.310048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f79c6-6500-4242-8136-ea9186900355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:35.310944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f79c6-6500-4242-8136-ea9186900355 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:35.311235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f79c6-6500-4242-8136-ea9186900355 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:35.311516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f79c6-6500-4242-8136-ea9186900355 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:35.328780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f79c6-6500-4242-8136-ea9186900355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-6a6f79c6-6500-4242-8136-ea9186900355 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:35.337381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:35.338322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:35.339165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 75/144] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:35.346690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0166-3d0c-463e-b703-b74052856124 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:35.418173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:35.486738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0166-3d0c-463e-b703-b74052856124 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:35.536816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818babcc-c5b2-4791-a09b-eb59af63ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:35.537519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818babcc-c5b2-4791-a09b-eb59af63ea1b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:35.537833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818babcc-c5b2-4791-a09b-eb59af63ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:35.538138 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818babcc-c5b2-4791-a09b-eb59af63ea1b None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:35.538986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818babcc-c5b2-4791-a09b-eb59af63ea1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:35.539299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818babcc-c5b2-4791-a09b-eb59af63ea1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:35.540846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818babcc-c5b2-4791-a09b-eb59af63ea1b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:35.554994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 70/145] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:35.561060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f79c6-6500-4242-8136-ea9186900355 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:35.585344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:35.696821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f79c6-6500-4242-8136-ea9186900355 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:35.748961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78658e8a-0e29-49ea-9784-971222117ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:35.749878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78658e8a-0e29-49ea-9784-971222117ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:35.750203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78658e8a-0e29-49ea-9784-971222117ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:35.750522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78658e8a-0e29-49ea-9784-971222117ff0 None admin] PATH_INFO: `/v3/users/1f5dea6992a4447085d8377492272c61` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:35.751880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78658e8a-0e29-49ea-9784-971222117ff0 None admin] RBAC: Authorizing `identity:get_user(user_id=1f5dea6992a4447085d8377492272c61)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:35.753473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78658e8a-0e29-49ea-9784-971222117ff0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:35.755699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 76/146] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:35 2022] GET /identity/v3/users/1f5dea6992a4447085d8377492272c61 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:35.761453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818babcc-c5b2-4791-a09b-eb59af63ea1b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:35.899165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818babcc-c5b2-4791-a09b-eb59af63ea1b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:35.907744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:35.943953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8a020-8df6-4571-9e30-6b1993a39f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:35.944651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a020-8df6-4571-9e30-6b1993a39f72 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:35.944944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a020-8df6-4571-9e30-6b1993a39f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:35.945225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a020-8df6-4571-9e30-6b1993a39f72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:36.042126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8a020-8df6-4571-9e30-6b1993a39f72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:36.043734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8a020-8df6-4571-9e30-6b1993a39f72 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:36.161732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 71/147] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:36.167516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78658e8a-0e29-49ea-9784-971222117ff0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:36.310675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:36.358201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78658e8a-0e29-49ea-9784-971222117ff0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:36.400360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1508215-609c-44b6-856d-48d3c2349720 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:36.400699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1508215-609c-44b6-856d-48d3c2349720 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:36.400919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1508215-609c-44b6-856d-48d3c2349720 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:36.402306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 72/148] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:36.412235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab7f69-76ea-48a1-a559-e70b1c77059b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:36.412484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab7f69-76ea-48a1-a559-e70b1c77059b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:36.412712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab7f69-76ea-48a1-a559-e70b1c77059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:36.415285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7686bf1-29a1-418b-a3d2-f0bee74fa7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:36.416247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7686bf1-29a1-418b-a3d2-f0bee74fa7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:36.416541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7686bf1-29a1-418b-a3d2-f0bee74fa7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:36.416850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7686bf1-29a1-418b-a3d2-f0bee74fa7e9 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:36.418090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7686bf1-29a1-418b-a3d2-f0bee74fa7e9 None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:36.419791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7686bf1-29a1-418b-a3d2-f0bee74fa7e9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:36.421991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 77/149] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:36 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:36.427334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7686bf1-29a1-418b-a3d2-f0bee74fa7e9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:36.433075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:36.447715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-efab7f69-76ea-48a1-a559-e70b1c77059b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:36.448898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-efab7f69-76ea-48a1-a559-e70b1c77059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:36.548031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7686bf1-29a1-418b-a3d2-f0bee74fa7e9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:36.589919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb2889-4544-44df-ab8c-0b08607ea6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:36.591363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb2889-4544-44df-ab8c-0b08607ea6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:36.591678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb2889-4544-44df-ab8c-0b08607ea6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:36.592012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb2889-4544-44df-ab8c-0b08607ea6f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:36.592908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb2889-4544-44df-ab8c-0b08607ea6f8 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=784d0612b566498b8205942e82777be5, user.id=1f5dea6992a4447085d8377492272c61) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:36.593240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb2889-4544-44df-ab8c-0b08607ea6f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:36.594827 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb2889-4544-44df-ab8c-0b08607ea6f8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:36.601880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 78/150] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:36 2022] GET /identity/v3/role_assignments?user.id=1f5dea6992a4447085d8377492272c61&scope.project.id=784d0612b566498b8205942e82777be5&role.id=af8084c48e3c40298e26d44d6d14595a => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:36.641071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 73/151] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:36.695396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb2889-4544-44df-ab8c-0b08607ea6f8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:36.718481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:36.850195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb2889-4544-44df-ab8c-0b08607ea6f8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:36.897915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d0bda-e137-4df2-8e1c-dab0e60186bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:36.899142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d0bda-e137-4df2-8e1c-dab0e60186bf None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:36.899665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d0bda-e137-4df2-8e1c-dab0e60186bf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:36.900127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d0bda-e137-4df2-8e1c-dab0e60186bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:36.917036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d0bda-e137-4df2-8e1c-dab0e60186bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-ac2d0bda-e137-4df2-8e1c-dab0e60186bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:36.930867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:36.931788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:36.932568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:36.934832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 79/152] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:36.943865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab7f69-76ea-48a1-a559-e70b1c77059b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:37.094256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab7f69-76ea-48a1-a559-e70b1c77059b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:37.139445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6488a-ef21-4c46-b09f-6cb077be3e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:37.140132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6488a-ef21-4c46-b09f-6cb077be3e80 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.140413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6488a-ef21-4c46-b09f-6cb077be3e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.140688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6488a-ef21-4c46-b09f-6cb077be3e80 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.141450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6488a-ef21-4c46-b09f-6cb077be3e80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:37.141756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6488a-ef21-4c46-b09f-6cb077be3e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:37.143202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6488a-ef21-4c46-b09f-6cb077be3e80 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:37.145778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:37.158011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 74/153] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:37.163604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d0bda-e137-4df2-8e1c-dab0e60186bf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:37.267593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:37.284555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6815-dd6f-47bf-9a46-ca659e178f3b None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.285184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6815-dd6f-47bf-9a46-ca659e178f3b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.285684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6815-dd6f-47bf-9a46-ca659e178f3b None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.287310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 75/154] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:37.296050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d95d3-5bb7-48d9-9d61-e18e4ccb7c18 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.296626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d95d3-5bb7-48d9-9d61-e18e4ccb7c18 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.297098 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d95d3-5bb7-48d9-9d61-e18e4ccb7c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.307727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d0bda-e137-4df2-8e1c-dab0e60186bf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:37.335727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-538d95d3-5bb7-48d9-9d61-e18e4ccb7c18 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:37.337244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-538d95d3-5bb7-48d9-9d61-e18e4ccb7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:37.350612 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4205b7-610c-4e5a-a69f-09a62e9a58ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:37.354984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4205b7-610c-4e5a-a69f-09a62e9a58ce None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.354984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4205b7-610c-4e5a-a69f-09a62e9a58ce None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.354984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4205b7-610c-4e5a-a69f-09a62e9a58ce None admin] PATH_INFO: `/v3/users/aba599d1ea884a348b5721b8457305fb` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.357386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4205b7-610c-4e5a-a69f-09a62e9a58ce None admin] RBAC: Authorizing `identity:get_user(user_id=aba599d1ea884a348b5721b8457305fb)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:37.362728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4205b7-610c-4e5a-a69f-09a62e9a58ce None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:37.362728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 80/155] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:37 2022] GET /identity/v3/users/aba599d1ea884a348b5721b8457305fb => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:37.366737 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4205b7-610c-4e5a-a69f-09a62e9a58ce None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:37.448513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 76/156] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:37.469515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2a65-edcd-4a9b-90f1-c533dc4262c3 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.470120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2a65-edcd-4a9b-90f1-c533dc4262c3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.470607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2a65-edcd-4a9b-90f1-c533dc4262c3 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.472249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 77/157] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:37.480198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc278a4-99de-4a78-9321-ed8d1e48a3a6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.480748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc278a4-99de-4a78-9321-ed8d1e48a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.481326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc278a4-99de-4a78-9321-ed8d1e48a3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.507318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9cc278a4-99de-4a78-9321-ed8d1e48a3a6 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:37.509112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9cc278a4-99de-4a78-9321-ed8d1e48a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:37.520472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4205b7-610c-4e5a-a69f-09a62e9a58ce None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:37.561543 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaf37d-74fd-4038-ab70-ac5658522a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:37.562389 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf37d-74fd-4038-ab70-ac5658522a1f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.562691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf37d-74fd-4038-ab70-ac5658522a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.562993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf37d-74fd-4038-ab70-ac5658522a1f None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.566824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceaf37d-74fd-4038-ab70-ac5658522a1f None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:37.572794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceaf37d-74fd-4038-ab70-ac5658522a1f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:37.574737 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 81/158] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:37 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:37.576270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaf37d-74fd-4038-ab70-ac5658522a1f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:37.591785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:37.637338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 78/159] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:37.637998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc278a4-99de-4a78-9321-ed8d1e48a3a6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:37.707602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaf37d-74fd-4038-ab70-ac5658522a1f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:37.747633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241ce33-4f52-4713-97c8-411b60772a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:37.748981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241ce33-4f52-4713-97c8-411b60772a53 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.749513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241ce33-4f52-4713-97c8-411b60772a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.750015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241ce33-4f52-4713-97c8-411b60772a53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.763283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241ce33-4f52-4713-97c8-411b60772a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0241ce33-4f52-4713-97c8-411b60772a53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:37.772792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:37.773715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:37.774604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:37.775253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:37.778016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 82/160] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:53:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:37.779294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241ce33-4f52-4713-97c8-411b60772a53 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:37.859904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:37.892888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc278a4-99de-4a78-9321-ed8d1e48a3a6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:37.896848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241ce33-4f52-4713-97c8-411b60772a53 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:37.933551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b4f7e-6a2c-498f-b03c-1c356d257395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:37.934853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b4f7e-6a2c-498f-b03c-1c356d257395 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.935391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b4f7e-6a2c-498f-b03c-1c356d257395 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.935916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b4f7e-6a2c-498f-b03c-1c356d257395 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.948009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b4f7e-6a2c-498f-b03c-1c356d257395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-597b4f7e-6a2c-498f-b03c-1c356d257395 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:37.962541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:37.963592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:37.964432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:37.969461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 83/161] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:37.972344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bdf13-f83d-4467-b385-ee08c235b08d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.973204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bdf13-f83d-4467-b385-ee08c235b08d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.974728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bdf13-f83d-4467-b385-ee08c235b08d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.976371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 84/162] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:37.979391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bdf13-f83d-4467-b385-ee08c235b08d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:37.986147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c562c-d370-44dc-839b-541122a18b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:37.988956 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c562c-d370-44dc-839b-541122a18b02 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:37.989516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c562c-d370-44dc-839b-541122a18b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:37.990726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c562c-d370-44dc-839b-541122a18b02 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5/users/aba599d1ea884a348b5721b8457305fb/roles/ddd16047c21a4707886ce223206a83de` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:37.995969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c562c-d370-44dc-839b-541122a18b02 None admin] RBAC: Authorizing `identity:create_grant(project_id=784d0612b566498b8205942e82777be5, user_id=aba599d1ea884a348b5721b8457305fb, role_id=ddd16047c21a4707886ce223206a83de)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:38.001265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c562c-d370-44dc-839b-541122a18b02 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:38.023663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 79/163] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:53:37 2022] PUT /identity/v3/projects/784d0612b566498b8205942e82777be5/users/aba599d1ea884a348b5721b8457305fb/roles/ddd16047c21a4707886ce223206a83de => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:53:38.025436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c562c-d370-44dc-839b-541122a18b02 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:38.236579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c562c-d370-44dc-839b-541122a18b02 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:38.252364 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bdf13-f83d-4467-b385-ee08c235b08d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:38.295927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:38.312414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:38.323526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b5f07-119c-45bd-8cec-35b8b6508c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:38.324211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5f07-119c-45bd-8cec-35b8b6508c7c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:38.324500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5f07-119c-45bd-8cec-35b8b6508c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:38.325534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5f07-119c-45bd-8cec-35b8b6508c7c None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:38.326304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b5f07-119c-45bd-8cec-35b8b6508c7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:38.326608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b5f07-119c-45bd-8cec-35b8b6508c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:38.327387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bccd7-7e14-4701-abd6-af4a1dc9e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:38.328046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bccd7-7e14-4701-abd6-af4a1dc9e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:38.328321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bccd7-7e14-4701-abd6-af4a1dc9e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:38.328582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bccd7-7e14-4701-abd6-af4a1dc9e2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:38.329328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bccd7-7e14-4701-abd6-af4a1dc9e2b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:38.329627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bccd7-7e14-4701-abd6-af4a1dc9e2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:38.331026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bccd7-7e14-4701-abd6-af4a1dc9e2b3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:38.333784 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b5f07-119c-45bd-8cec-35b8b6508c7c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:38.346429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 85/164] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:53:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:38.347744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ace4e2-0514-4c77-8ae1-177d1d5e228e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:38.348031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ace4e2-0514-4c77-8ae1-177d1d5e228e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:38.348308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ace4e2-0514-4c77-8ae1-177d1d5e228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:38.351469 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 80/165] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:38.352330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b5f07-119c-45bd-8cec-35b8b6508c7c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:38.380186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b6ace4e2-0514-4c77-8ae1-177d1d5e228e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:38.381363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b6ace4e2-0514-4c77-8ae1-177d1d5e228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:38.510198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b5f07-119c-45bd-8cec-35b8b6508c7c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:38.559629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 86/166] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:38.560956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ace4e2-0514-4c77-8ae1-177d1d5e228e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:38.569333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ceba9f-7484-4475-82ea-946767274a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:38.570216 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceba9f-7484-4475-82ea-946767274a43 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:38.570504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceba9f-7484-4475-82ea-946767274a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:38.570814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceba9f-7484-4475-82ea-946767274a43 None admin] PATH_INFO: `/v3/users/0cf3f752e71f49dda8072b132321a74f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:38.572223 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ceba9f-7484-4475-82ea-946767274a43 None admin] RBAC: Authorizing `identity:get_user(user_id=0cf3f752e71f49dda8072b132321a74f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:38.573680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ceba9f-7484-4475-82ea-946767274a43 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:38.576454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 81/167] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:38 2022] GET /identity/v3/users/0cf3f752e71f49dda8072b132321a74f => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:38.583885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ceba9f-7484-4475-82ea-946767274a43 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:38.671206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ace4e2-0514-4c77-8ae1-177d1d5e228e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:38.676197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:38.696825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:38.710858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcd99e-b9a8-4f46-97a0-34694525eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:38.713064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcd99e-b9a8-4f46-97a0-34694525eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:38.713877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcd99e-b9a8-4f46-97a0-34694525eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:38.714677 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcd99e-b9a8-4f46-97a0-34694525eac4 None admin] PATH_INFO: `/v3/users/0cf3f752e71f49dda8072b132321a74f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:38.717373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcd99e-b9a8-4f46-97a0-34694525eac4 None admin] RBAC: Authorizing `identity:get_user(user_id=0cf3f752e71f49dda8072b132321a74f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:38.720195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcd99e-b9a8-4f46-97a0-34694525eac4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:38.722646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 87/168] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:38 2022] GET /identity/v3/users/0cf3f752e71f49dda8072b132321a74f => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:38.723855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcd99e-b9a8-4f46-97a0-34694525eac4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:38.746763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ceba9f-7484-4475-82ea-946767274a43 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:38.797091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa480e7-d53f-4256-960f-0da6283de6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:38.797658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa480e7-d53f-4256-960f-0da6283de6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:38.797940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa480e7-d53f-4256-960f-0da6283de6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:38.798220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa480e7-d53f-4256-960f-0da6283de6c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:38.845448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcd99e-b9a8-4f46-97a0-34694525eac4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:38.883009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d4212-8618-4acb-bc4c-69a3fefefaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:38.884568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d4212-8618-4acb-bc4c-69a3fefefaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:38.885076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d4212-8618-4acb-bc4c-69a3fefefaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:38.885560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d4212-8618-4acb-bc4c-69a3fefefaa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:38.897764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d4212-8618-4acb-bc4c-69a3fefefaa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-d67d4212-8618-4acb-bc4c-69a3fefefaa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:38.906407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:38.907365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:38.908177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:38.910572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 88/169] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:38.911662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d4212-8618-4acb-bc4c-69a3fefefaa0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:38.917510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa480e7-d53f-4256-960f-0da6283de6c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:38.919348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa480e7-d53f-4256-960f-0da6283de6c9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:38.972409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:39.022239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:39.035304 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d4212-8618-4acb-bc4c-69a3fefefaa0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:39.076861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044135a-07c1-43fc-81d4-183e4a53602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:39.077934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044135a-07c1-43fc-81d4-183e4a53602f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:39.078437 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044135a-07c1-43fc-81d4-183e4a53602f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:39.079006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044135a-07c1-43fc-81d4-183e4a53602f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:39.159438 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 82/170] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:39.160306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa480e7-d53f-4256-960f-0da6283de6c9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:39.164155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044135a-07c1-43fc-81d4-183e4a53602f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:39.166169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044135a-07c1-43fc-81d4-183e4a53602f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:39.251067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:39.290526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 89/171] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:39.292741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72000b-3db4-4f51-8aae-d6312a9649a3 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:39.293251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72000b-3db4-4f51-8aae-d6312a9649a3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:39.294325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72000b-3db4-4f51-8aae-d6312a9649a3 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:39.296401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 90/172] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:39.297429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72000b-3db4-4f51-8aae-d6312a9649a3 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:39.355394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa480e7-d53f-4256-960f-0da6283de6c9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:39.416579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72000b-3db4-4f51-8aae-d6312a9649a3 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:39.428842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef5c21-dd0f-460a-b454-082951b50078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:39.429728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef5c21-dd0f-460a-b454-082951b50078 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:39.429851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef5c21-dd0f-460a-b454-082951b50078 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:39.430072 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef5c21-dd0f-460a-b454-082951b50078 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:39.430866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef5c21-dd0f-460a-b454-082951b50078 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:39.431178 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef5c21-dd0f-460a-b454-082951b50078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:39.432559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef5c21-dd0f-460a-b454-082951b50078 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:39.461080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 83/173] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:39.461774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef5c21-dd0f-460a-b454-082951b50078 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:39.466240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9dd88-b8ca-40ef-b4db-0065c278b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:39.467634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dd88-b8ca-40ef-b4db-0065c278b7ba None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:39.468175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dd88-b8ca-40ef-b4db-0065c278b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:39.468674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dd88-b8ca-40ef-b4db-0065c278b7ba None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:39.470375 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9dd88-b8ca-40ef-b4db-0065c278b7ba None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:39.472255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9dd88-b8ca-40ef-b4db-0065c278b7ba None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:39.474754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 91/174] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:39 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:39.476692 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324264c-642e-4c84-a127-9a5d852a9571 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:39.477248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324264c-642e-4c84-a127-9a5d852a9571 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:39.477776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324264c-642e-4c84-a127-9a5d852a9571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:39.500127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e324264c-642e-4c84-a127-9a5d852a9571 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:39.501901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e324264c-642e-4c84-a127-9a5d852a9571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:39.504642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:39.531092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:39.617012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 92/175] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:39.617981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324264c-642e-4c84-a127-9a5d852a9571 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:39.704354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef5c21-dd0f-460a-b454-082951b50078 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:39.738983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e512bf-43d7-4656-9a47-dfe659e94883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:39.739853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e512bf-43d7-4656-9a47-dfe659e94883 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:39.740139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e512bf-43d7-4656-9a47-dfe659e94883 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:39.740414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e512bf-43d7-4656-9a47-dfe659e94883 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:39.741612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e512bf-43d7-4656-9a47-dfe659e94883 None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:39.743085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e512bf-43d7-4656-9a47-dfe659e94883 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:39.744799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 84/176] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:39 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:39.750991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e512bf-43d7-4656-9a47-dfe659e94883 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:39.767530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324264c-642e-4c84-a127-9a5d852a9571 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:39.807256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eab610-781a-4aef-bda8-12074e552253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:39.808515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eab610-781a-4aef-bda8-12074e552253 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:39.808515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eab610-781a-4aef-bda8-12074e552253 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:39.808907 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eab610-781a-4aef-bda8-12074e552253 None admin] PATH_INFO: `/v3/users/0cf3f752e71f49dda8072b132321a74f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:39.810126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eab610-781a-4aef-bda8-12074e552253 None admin] RBAC: Authorizing `identity:get_user(user_id=0cf3f752e71f49dda8072b132321a74f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:39.811642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eab610-781a-4aef-bda8-12074e552253 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:39.817516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 93/177] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:39 2022] GET /identity/v3/users/0cf3f752e71f49dda8072b132321a74f => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:39.817516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eab610-781a-4aef-bda8-12074e552253 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:39.833344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:39.848119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:39.872009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e512bf-43d7-4656-9a47-dfe659e94883 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:39.907275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3dc74-0cf8-482e-b495-1b6bcdf8c977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:39.907935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3dc74-0cf8-482e-b495-1b6bcdf8c977 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:39.908224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3dc74-0cf8-482e-b495-1b6bcdf8c977 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:39.908499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3dc74-0cf8-482e-b495-1b6bcdf8c977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:39.909334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3dc74-0cf8-482e-b495-1b6bcdf8c977 None admin] RBAC: Adding query filter params (role.id=66b09c60197a4a1fb2cca5402bb83375, scope.project.id=784d0612b566498b8205942e82777be5, user.id=0cf3f752e71f49dda8072b132321a74f) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:39.909656 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3dc74-0cf8-482e-b495-1b6bcdf8c977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:39.911126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3dc74-0cf8-482e-b495-1b6bcdf8c977 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:39.917776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 85/178] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:39 2022] GET /identity/v3/role_assignments?user.id=0cf3f752e71f49dda8072b132321a74f&scope.project.id=784d0612b566498b8205942e82777be5&role.id=66b09c60197a4a1fb2cca5402bb83375 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:39.919316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ae06-e25a-4633-805a-fceab2bcf2b3 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:39.919607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ae06-e25a-4633-805a-fceab2bcf2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:39.919897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ae06-e25a-4633-805a-fceab2bcf2b3 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:39.921327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 86/179] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:39.926776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5292e2-ea97-44f1-a565-a514849de77e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:39.927070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5292e2-ea97-44f1-a565-a514849de77e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:39.927360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5292e2-ea97-44f1-a565-a514849de77e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:39.928786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 87/180] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:39.929539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5292e2-ea97-44f1-a565-a514849de77e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:39.942528 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eab610-781a-4aef-bda8-12074e552253 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:39.998194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c619823-49a8-42f9-84e2-70bf406b3435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:39.999659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c619823-49a8-42f9-84e2-70bf406b3435 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:40.000692 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c619823-49a8-42f9-84e2-70bf406b3435 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:40.001550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c619823-49a8-42f9-84e2-70bf406b3435 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:40.020552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c619823-49a8-42f9-84e2-70bf406b3435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1c619823-49a8-42f9-84e2-70bf406b3435 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:40.033842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:40.034997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:40.035836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:40.037661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 94/181] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:40.037661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c619823-49a8-42f9-84e2-70bf406b3435 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:40.053750 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5292e2-ea97-44f1-a565-a514849de77e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:40.095393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725e34-4ad9-491d-8c16-979b8162037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:40.096173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725e34-4ad9-491d-8c16-979b8162037a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:40.096462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725e34-4ad9-491d-8c16-979b8162037a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:40.096746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725e34-4ad9-491d-8c16-979b8162037a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:40.099064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725e34-4ad9-491d-8c16-979b8162037a None admin] RBAC: Adding query filter params (role.id=bce93d0b549349079c3292eb120d54c1, scope.project.id=784d0612b566498b8205942e82777be5, user.id=0cf3f752e71f49dda8072b132321a74f) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:40.099064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725e34-4ad9-491d-8c16-979b8162037a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:40.099926 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725e34-4ad9-491d-8c16-979b8162037a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:40.111843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 88/182] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:39 2022] GET /identity/v3/role_assignments?user.id=0cf3f752e71f49dda8072b132321a74f&scope.project.id=784d0612b566498b8205942e82777be5&role.id=bce93d0b549349079c3292eb120d54c1 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:40.113621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6f3c-cf52-45ad-838c-b988e0533ff8 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:40.113735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6f3c-cf52-45ad-838c-b988e0533ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:40.114185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6f3c-cf52-45ad-838c-b988e0533ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:40.135306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:40.153036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6a5d6f3c-cf52-45ad-838c-b988e0533ff8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:40.156005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6a5d6f3c-cf52-45ad-838c-b988e0533ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:40.176936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:40.208660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c619823-49a8-42f9-84e2-70bf406b3435 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:40.258033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0ff5e-55d1-45cc-bc17-b90dd045a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:40.259204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ff5e-55d1-45cc-bc17-b90dd045a89f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:40.259492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ff5e-55d1-45cc-bc17-b90dd045a89f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:40.259816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ff5e-55d1-45cc-bc17-b90dd045a89f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:40.267661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 89/183] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:40.269402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccbbd9-e658-44be-8520-942517019a77 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:40.269922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccbbd9-e658-44be-8520-942517019a77 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:40.270993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccbbd9-e658-44be-8520-942517019a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:40.289609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9dccbbd9-e658-44be-8520-942517019a77 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:40.290844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9dccbbd9-e658-44be-8520-942517019a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:40.338342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0ff5e-55d1-45cc-bc17-b90dd045a89f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:40.340285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0ff5e-55d1-45cc-bc17-b90dd045a89f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:40.372018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 90/184] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:40.379065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccbbd9-e658-44be-8520-942517019a77 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:40.463384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:40.472903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:40.514670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccbbd9-e658-44be-8520-942517019a77 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:40.517334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 95/185] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:40.524967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0ff5e-55d1-45cc-bc17-b90dd045a89f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:40.557908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1ebca-2581-4ca4-806c-d6f2ef88b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:40.558576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1ebca-2581-4ca4-806c-d6f2ef88b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:40.559378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1ebca-2581-4ca4-806c-d6f2ef88b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:40.559706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1ebca-2581-4ca4-806c-d6f2ef88b7a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:40.560804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1ebca-2581-4ca4-806c-d6f2ef88b7a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:40.561114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1ebca-2581-4ca4-806c-d6f2ef88b7a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:40.562506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1ebca-2581-4ca4-806c-d6f2ef88b7a7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:40.575532 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 91/186] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:40.575532 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1ebca-2581-4ca4-806c-d6f2ef88b7a7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:40.641745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0ff5e-55d1-45cc-bc17-b90dd045a89f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:40.679541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b2f44-cfb9-49da-8a1e-6a1713dfcdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:40.680372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b2f44-cfb9-49da-8a1e-6a1713dfcdab None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:40.680655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b2f44-cfb9-49da-8a1e-6a1713dfcdab None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:40.680947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b2f44-cfb9-49da-8a1e-6a1713dfcdab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:40.681923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1ebca-2581-4ca4-806c-d6f2ef88b7a7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:40.682172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b2f44-cfb9-49da-8a1e-6a1713dfcdab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:40.683708 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b2f44-cfb9-49da-8a1e-6a1713dfcdab None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:40.686368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 96/187] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:40.687544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b2f44-cfb9-49da-8a1e-6a1713dfcdab None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:40.711654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:40.721402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedbec9-2964-4f50-a40b-b7a711146f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:40.722151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedbec9-2964-4f50-a40b-b7a711146f65 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:40.722436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedbec9-2964-4f50-a40b-b7a711146f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:40.722742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedbec9-2964-4f50-a40b-b7a711146f65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:40.734038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedbec9-2964-4f50-a40b-b7a711146f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:40.739594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-deedbec9-2964-4f50-a40b-b7a711146f65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:40.742230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:40.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:40.744245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 92/188] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:53:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:40.744899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedbec9-2964-4f50-a40b-b7a711146f65 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:40.807679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b2f44-cfb9-49da-8a1e-6a1713dfcdab None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:40.848767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c896e8-fe4c-46a2-95c9-882e0052786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:40.849709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c896e8-fe4c-46a2-95c9-882e0052786b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:40.850013 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c896e8-fe4c-46a2-95c9-882e0052786b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:40.850323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c896e8-fe4c-46a2-95c9-882e0052786b None admin] PATH_INFO: `/v3/projects/6bf3d5cfa2794b7f81d7d0e41e31ff4e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:40.851652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c896e8-fe4c-46a2-95c9-882e0052786b None admin] RBAC: Authorizing `identity:get_project(project_id=6bf3d5cfa2794b7f81d7d0e41e31ff4e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:40.853306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c896e8-fe4c-46a2-95c9-882e0052786b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:40.855410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 97/189] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:40 2022] GET /identity/v3/projects/6bf3d5cfa2794b7f81d7d0e41e31ff4e => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:40.856642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c896e8-fe4c-46a2-95c9-882e0052786b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:40.868246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedbec9-2964-4f50-a40b-b7a711146f65 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:40.906581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f200c-9701-4238-b0a9-1d7980b37737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:40.907674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f200c-9701-4238-b0a9-1d7980b37737 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:40.907783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f200c-9701-4238-b0a9-1d7980b37737 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:40.908027 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f200c-9701-4238-b0a9-1d7980b37737 None admin] PATH_INFO: `/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:40.923024 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f200c-9701-4238-b0a9-1d7980b37737 None admin] RBAC: Authorizing `identity:get_user(user_id=3f5f487a07cc4589a4506fcd8fdf50c7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:40.924486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f200c-9701-4238-b0a9-1d7980b37737 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:40.930378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 93/190] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:40 2022] GET /identity/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:40.930378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f200c-9701-4238-b0a9-1d7980b37737 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:40.966934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c896e8-fe4c-46a2-95c9-882e0052786b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:40.978045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:40.980132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:41.002589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314852d-5c15-4703-967f-0b1a1852d7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:41.003294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314852d-5c15-4703-967f-0b1a1852d7df None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:41.003578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314852d-5c15-4703-967f-0b1a1852d7df None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:41.003858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314852d-5c15-4703-967f-0b1a1852d7df None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:41.004570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314852d-5c15-4703-967f-0b1a1852d7df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:41.006042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314852d-5c15-4703-967f-0b1a1852d7df None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:41.024872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 98/191] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:53:40 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:41.026133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314852d-5c15-4703-967f-0b1a1852d7df None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:41.034377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f200c-9701-4238-b0a9-1d7980b37737 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:41.079019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ee352-db07-43cd-a63d-55f5b5fd19c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:41.080244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee352-db07-43cd-a63d-55f5b5fd19c5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:41.080537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee352-db07-43cd-a63d-55f5b5fd19c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:41.081103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee352-db07-43cd-a63d-55f5b5fd19c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:41.081892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ee352-db07-43cd-a63d-55f5b5fd19c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:41.082476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ee352-db07-43cd-a63d-55f5b5fd19c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:41.084402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ee352-db07-43cd-a63d-55f5b5fd19c5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:41.095044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 94/192] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:53:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:41.096271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ee352-db07-43cd-a63d-55f5b5fd19c5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:41.148583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314852d-5c15-4703-967f-0b1a1852d7df None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:41.191160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a1b1b-b16b-41ef-9bad-00f6fc35b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:41.191833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1b1b-b16b-41ef-9bad-00f6fc35b616 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:41.192118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1b1b-b16b-41ef-9bad-00f6fc35b616 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:41.192396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1b1b-b16b-41ef-9bad-00f6fc35b616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:41.193246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a1b1b-b16b-41ef-9bad-00f6fc35b616 None admin] RBAC: Adding query filter params (role.id=bce93d0b549349079c3292eb120d54c1, scope.project.id=6bf3d5cfa2794b7f81d7d0e41e31ff4e, user.id=0cf3f752e71f49dda8072b132321a74f) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:41.193561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a1b1b-b16b-41ef-9bad-00f6fc35b616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:41.195077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a1b1b-b16b-41ef-9bad-00f6fc35b616 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:41.211991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 99/193] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:41 2022] GET /identity/v3/role_assignments?user.id=0cf3f752e71f49dda8072b132321a74f&scope.project.id=6bf3d5cfa2794b7f81d7d0e41e31ff4e&role.id=bce93d0b549349079c3292eb120d54c1 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:41.211991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec505-b74a-4b9d-a405-b92a06665654 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:41.211991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec505-b74a-4b9d-a405-b92a06665654 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:41.211991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec505-b74a-4b9d-a405-b92a06665654 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:41.211991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 100/194] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:41.211991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ec505-b74a-4b9d-a405-b92a06665654 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:41.222025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ee352-db07-43cd-a63d-55f5b5fd19c5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:41.233521 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:41.258287 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:41.276245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eabfd0-2898-451f-90ee-37c13d136fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:41.276245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eabfd0-2898-451f-90ee-37c13d136fac None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:41.277234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eabfd0-2898-451f-90ee-37c13d136fac None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:41.277363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eabfd0-2898-451f-90ee-37c13d136fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:41.365977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ec505-b74a-4b9d-a405-b92a06665654 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:41.383596 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eabfd0-2898-451f-90ee-37c13d136fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:41.385654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eabfd0-2898-451f-90ee-37c13d136fac None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:41.422340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890d640-1a5a-475c-978b-4586550466d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:41.423628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890d640-1a5a-475c-978b-4586550466d8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:41.423915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890d640-1a5a-475c-978b-4586550466d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:41.424190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890d640-1a5a-475c-978b-4586550466d8 None admin] PATH_INFO: `/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:41.426484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890d640-1a5a-475c-978b-4586550466d8 None admin] RBAC: Authorizing `identity:get_user(user_id=3f5f487a07cc4589a4506fcd8fdf50c7)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:41.428005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890d640-1a5a-475c-978b-4586550466d8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:41.431372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 101/195] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:41 2022] GET /identity/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:41.432441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f9f9c-f5a4-4bc8-af07-b0ba383ec53c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:41.432695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f9f9c-f5a4-4bc8-af07-b0ba383ec53c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:41.432971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f9f9c-f5a4-4bc8-af07-b0ba383ec53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:41.455941 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-222f9f9c-f5a4-4bc8-af07-b0ba383ec53c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:41.457491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-222f9f9c-f5a4-4bc8-af07-b0ba383ec53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:41.536075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 95/196] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:41.537312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eabfd0-2898-451f-90ee-37c13d136fac None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:41.551061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:41.567855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 102/197] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:41.568497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f9f9c-f5a4-4bc8-af07-b0ba383ec53c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:41.609105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:41.685912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eabfd0-2898-451f-90ee-37c13d136fac None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:41.690230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f9f9c-f5a4-4bc8-af07-b0ba383ec53c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:41.729940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3ce70-58ed-4e96-941d-92bcd01eb7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:41.731892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3ce70-58ed-4e96-941d-92bcd01eb7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:41.731892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3ce70-58ed-4e96-941d-92bcd01eb7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:41.732160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519778c3-f257-4b48-a834-1ec5e9757663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:41.732271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3ce70-58ed-4e96-941d-92bcd01eb7f5 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:41.732978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519778c3-f257-4b48-a834-1ec5e9757663 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:41.733263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519778c3-f257-4b48-a834-1ec5e9757663 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:41.733541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519778c3-f257-4b48-a834-1ec5e9757663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:41.733634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3ce70-58ed-4e96-941d-92bcd01eb7f5 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:41.735259 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3ce70-58ed-4e96-941d-92bcd01eb7f5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:41.737039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 103/198] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:41 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:41.737877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3ce70-58ed-4e96-941d-92bcd01eb7f5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:41.826132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519778c3-f257-4b48-a834-1ec5e9757663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:41.827741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519778c3-f257-4b48-a834-1ec5e9757663 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:41.842913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:41.854356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:41.859344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3ce70-58ed-4e96-941d-92bcd01eb7f5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:41.896282 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7901ae-0b82-4ffa-9f6a-ebbf4e7c6b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:41.897329 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7901ae-0b82-4ffa-9f6a-ebbf4e7c6b24 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:41.897704 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7901ae-0b82-4ffa-9f6a-ebbf4e7c6b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:41.898069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7901ae-0b82-4ffa-9f6a-ebbf4e7c6b24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:41.910846 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7901ae-0b82-4ffa-9f6a-ebbf4e7c6b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-cb7901ae-0b82-4ffa-9f6a-ebbf4e7c6b24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:41.919469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:41.920538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:41.921549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:41.923655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 104/199] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:41.924631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7901ae-0b82-4ffa-9f6a-ebbf4e7c6b24 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:41.977339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 96/200] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:41.978188 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519778c3-f257-4b48-a834-1ec5e9757663 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:42.037320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7901ae-0b82-4ffa-9f6a-ebbf4e7c6b24 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:42.082508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69e2a1-6bdd-4fdd-aa3b-d9ce3d0ecd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:42.083318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69e2a1-6bdd-4fdd-aa3b-d9ce3d0ecd50 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:42.083601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69e2a1-6bdd-4fdd-aa3b-d9ce3d0ecd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:42.083872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69e2a1-6bdd-4fdd-aa3b-d9ce3d0ecd50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:42.085051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69e2a1-6bdd-4fdd-aa3b-d9ce3d0ecd50 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=f89df535b56543e3b83b59bc617ffd14, user.id=3f5f487a07cc4589a4506fcd8fdf50c7) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:42.085590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69e2a1-6bdd-4fdd-aa3b-d9ce3d0ecd50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:42.088058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69e2a1-6bdd-4fdd-aa3b-d9ce3d0ecd50 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:42.096126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519778c3-f257-4b48-a834-1ec5e9757663 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:42.096292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 105/201] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:41 2022] GET /identity/v3/role_assignments?user.id=3f5f487a07cc4589a4506fcd8fdf50c7&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=af8084c48e3c40298e26d44d6d14595a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:42.097063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69e2a1-6bdd-4fdd-aa3b-d9ce3d0ecd50 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:42.108994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:42.133991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:42.142213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f042-b9a7-401f-8b5c-5cf03c10c7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:42.144011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f042-b9a7-401f-8b5c-5cf03c10c7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:42.144544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f042-b9a7-401f-8b5c-5cf03c10c7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:42.145164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f042-b9a7-401f-8b5c-5cf03c10c7f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:42.146203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36f042-b9a7-401f-8b5c-5cf03c10c7f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:42.146736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36f042-b9a7-401f-8b5c-5cf03c10c7f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:42.148393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36f042-b9a7-401f-8b5c-5cf03c10c7f1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:42.159836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 97/202] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:42.172049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f042-b9a7-401f-8b5c-5cf03c10c7f1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:42.287503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69e2a1-6bdd-4fdd-aa3b-d9ce3d0ecd50 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:42.327994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4506f3-1b31-4d22-b91a-0d6e689e813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:42.328863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4506f3-1b31-4d22-b91a-0d6e689e813a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:42.329143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4506f3-1b31-4d22-b91a-0d6e689e813a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:42.329425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4506f3-1b31-4d22-b91a-0d6e689e813a None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:42.330654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4506f3-1b31-4d22-b91a-0d6e689e813a None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:42.332428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4506f3-1b31-4d22-b91a-0d6e689e813a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:42.334142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 106/203] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:42 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:42.339808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4506f3-1b31-4d22-b91a-0d6e689e813a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:42.343353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f042-b9a7-401f-8b5c-5cf03c10c7f1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:42.409353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa87d0-ce9a-4a25-a634-ea148e04a944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:42.411013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa87d0-ce9a-4a25-a634-ea148e04a944 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:42.411502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa87d0-ce9a-4a25-a634-ea148e04a944 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:42.411956 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa87d0-ce9a-4a25-a634-ea148e04a944 None admin] PATH_INFO: `/v3/users/aba599d1ea884a348b5721b8457305fb` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:42.413669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa87d0-ce9a-4a25-a634-ea148e04a944 None admin] RBAC: Authorizing `identity:get_user(user_id=aba599d1ea884a348b5721b8457305fb)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:42.415629 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa87d0-ce9a-4a25-a634-ea148e04a944 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:42.417448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 98/204] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:42 2022] GET /identity/v3/users/aba599d1ea884a348b5721b8457305fb => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:42.427459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa87d0-ce9a-4a25-a634-ea148e04a944 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:42.471345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:42.479364 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4506f3-1b31-4d22-b91a-0d6e689e813a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:42.523305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60e5c5-9e7b-4c87-a2a6-a1164f7565b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:42.523497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e5c5-9e7b-4c87-a2a6-a1164f7565b7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:42.530752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e5c5-9e7b-4c87-a2a6-a1164f7565b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:42.530752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e5c5-9e7b-4c87-a2a6-a1164f7565b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:42.530752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60e5c5-9e7b-4c87-a2a6-a1164f7565b7 None admin] RBAC: Adding query filter params (role.id=66b09c60197a4a1fb2cca5402bb83375, scope.project.id=f89df535b56543e3b83b59bc617ffd14, user.id=3f5f487a07cc4589a4506fcd8fdf50c7) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:42.530752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60e5c5-9e7b-4c87-a2a6-a1164f7565b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:42.530752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60e5c5-9e7b-4c87-a2a6-a1164f7565b7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:42.540414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 107/205] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:42 2022] GET /identity/v3/role_assignments?user.id=3f5f487a07cc4589a4506fcd8fdf50c7&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=66b09c60197a4a1fb2cca5402bb83375 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:42.543091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:42.651224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa87d0-ce9a-4a25-a634-ea148e04a944 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:42.716755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89620fe-88b0-480b-ab30-73d5911f3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:42.717455 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89620fe-88b0-480b-ab30-73d5911f3a95 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:42.717739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89620fe-88b0-480b-ab30-73d5911f3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:42.718013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89620fe-88b0-480b-ab30-73d5911f3a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:42.796955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89620fe-88b0-480b-ab30-73d5911f3a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:42.798475 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89620fe-88b0-480b-ab30-73d5911f3a95 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:42.856300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:42.943412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 99/206] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:42.948956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60e5c5-9e7b-4c87-a2a6-a1164f7565b7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:43.081655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60e5c5-9e7b-4c87-a2a6-a1164f7565b7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:43.126940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a96f0e-f4a0-432f-9d07-c18dfa7c10b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:43.128587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a96f0e-f4a0-432f-9d07-c18dfa7c10b4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:43.129109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a96f0e-f4a0-432f-9d07-c18dfa7c10b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:43.129615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a96f0e-f4a0-432f-9d07-c18dfa7c10b4 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:43.131502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a96f0e-f4a0-432f-9d07-c18dfa7c10b4 None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:43.134141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a96f0e-f4a0-432f-9d07-c18dfa7c10b4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:43.138190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 108/207] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:42 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:43.144013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89620fe-88b0-480b-ab30-73d5911f3a95 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:43.317552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89620fe-88b0-480b-ab30-73d5911f3a95 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:43.368310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafefd6-22f7-46ea-8126-0321e9ec1b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:43.369021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafefd6-22f7-46ea-8126-0321e9ec1b03 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:43.369307 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafefd6-22f7-46ea-8126-0321e9ec1b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:43.369633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafefd6-22f7-46ea-8126-0321e9ec1b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:43.370470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafefd6-22f7-46ea-8126-0321e9ec1b03 None admin] RBAC: Adding query filter params (role.id=ddd16047c21a4707886ce223206a83de, scope.project.id=784d0612b566498b8205942e82777be5, user.id=aba599d1ea884a348b5721b8457305fb) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:43.370854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafefd6-22f7-46ea-8126-0321e9ec1b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:43.372906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafefd6-22f7-46ea-8126-0321e9ec1b03 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:43.383497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 100/208] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:43 2022] GET /identity/v3/role_assignments?user.id=aba599d1ea884a348b5721b8457305fb&scope.project.id=784d0612b566498b8205942e82777be5&role.id=ddd16047c21a4707886ce223206a83de => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:43.826605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0da23-226b-45cd-b8fc-00a19c65e958 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:43.827042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0da23-226b-45cd-b8fc-00a19c65e958 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:43.827160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0da23-226b-45cd-b8fc-00a19c65e958 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:43.828557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 109/209] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:43.834158 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d7b8-1327-4909-8bbb-8655e40fcb15 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:43.834634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d7b8-1327-4909-8bbb-8655e40fcb15 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:43.834745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d7b8-1327-4909-8bbb-8655e40fcb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:43.844578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:43.857822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a3d7d7b8-1327-4909-8bbb-8655e40fcb15 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:43.859550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a3d7d7b8-1327-4909-8bbb-8655e40fcb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:43.950244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0ce40-579f-4937-ab8f-1fb7a72c93ec None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:43.950772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0ce40-579f-4937-ab8f-1fb7a72c93ec None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:43.950859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0ce40-579f-4937-ab8f-1fb7a72c93ec None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:43.952373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 110/210] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:43.959517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 101/211] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:43.959659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fb74d-c45f-4fe5-a9f4-f5472b8290d5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:43.959659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fb74d-c45f-4fe5-a9f4-f5472b8290d5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:43.959659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fb74d-c45f-4fe5-a9f4-f5472b8290d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:43.977779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ec7fb74d-c45f-4fe5-a9f4-f5472b8290d5 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:43.979285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ec7fb74d-c45f-4fe5-a9f4-f5472b8290d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:43.987763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7d7b8-1327-4909-8bbb-8655e40fcb15 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:44.035145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:44.066751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 111/212] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:44.085621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fb74d-c45f-4fe5-a9f4-f5472b8290d5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:44.095214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7d7b8-1327-4909-8bbb-8655e40fcb15 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:44.126116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:44.134868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32940a-d4ba-4d14-94a7-6a15fad7167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:44.135672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32940a-d4ba-4d14-94a7-6a15fad7167f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:44.135955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32940a-d4ba-4d14-94a7-6a15fad7167f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:44.136229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32940a-d4ba-4d14-94a7-6a15fad7167f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:44.151192 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32940a-d4ba-4d14-94a7-6a15fad7167f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5d32940a-d4ba-4d14-94a7-6a15fad7167f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:44.159659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:44.160534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:44.161328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:44.163681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 102/213] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:44.171778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32940a-d4ba-4d14-94a7-6a15fad7167f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:44.222139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fb74d-c45f-4fe5-a9f4-f5472b8290d5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:44.269348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75583612-ff53-4fe8-8ff2-8d69d106ea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:44.270477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75583612-ff53-4fe8-8ff2-8d69d106ea34 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:44.271481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75583612-ff53-4fe8-8ff2-8d69d106ea34 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:44.271947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75583612-ff53-4fe8-8ff2-8d69d106ea34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:44.273835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75583612-ff53-4fe8-8ff2-8d69d106ea34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:44.276310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75583612-ff53-4fe8-8ff2-8d69d106ea34 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:44.280324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 112/214] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:44.286732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75583612-ff53-4fe8-8ff2-8d69d106ea34 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:44.290137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32940a-d4ba-4d14-94a7-6a15fad7167f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:44.310465 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:44.329584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6efd46-7e0d-4733-b9cf-57f6402f1442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:44.330513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6efd46-7e0d-4733-b9cf-57f6402f1442 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:44.330975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6efd46-7e0d-4733-b9cf-57f6402f1442 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:44.331395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6efd46-7e0d-4733-b9cf-57f6402f1442 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:44.332280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6efd46-7e0d-4733-b9cf-57f6402f1442 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:44.332733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6efd46-7e0d-4733-b9cf-57f6402f1442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:44.334395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6efd46-7e0d-4733-b9cf-57f6402f1442 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:44.348663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 103/215] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:44.349782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6efd46-7e0d-4733-b9cf-57f6402f1442 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:44.394309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75583612-ff53-4fe8-8ff2-8d69d106ea34 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:44.410140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:44.430335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6b0c2-e4c5-412b-9876-f7329c952ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:44.431188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b0c2-e4c5-412b-9876-f7329c952ff3 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:44.431567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b0c2-e4c5-412b-9876-f7329c952ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:44.431937 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b0c2-e4c5-412b-9876-f7329c952ff3 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:44.433154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6b0c2-e4c5-412b-9876-f7329c952ff3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:44.434997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6b0c2-e4c5-412b-9876-f7329c952ff3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:44.457602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 113/216] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:53:44 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:53:44.464160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6efd46-7e0d-4733-b9cf-57f6402f1442 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:44.503899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f0762-ddfe-4747-bca2-dac6d0e227a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:44.505051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f0762-ddfe-4747-bca2-dac6d0e227a8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:44.505594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f0762-ddfe-4747-bca2-dac6d0e227a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:44.506019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f0762-ddfe-4747-bca2-dac6d0e227a8 None admin] PATH_INFO: `/v3/users/1d32c41524b642788914b2f81c8c746c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:44.544577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f0762-ddfe-4747-bca2-dac6d0e227a8 None admin] RBAC: Authorizing `identity:get_user(user_id=1d32c41524b642788914b2f81c8c746c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:44.547408 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f0762-ddfe-4747-bca2-dac6d0e227a8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:44.550557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 104/217] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:44 2022] GET /identity/v3/users/1d32c41524b642788914b2f81c8c746c => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:44.557785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6b0c2-e4c5-412b-9876-f7329c952ff3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:44.660078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:44.687288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6b0c2-e4c5-412b-9876-f7329c952ff3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:44.723006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9f162-73ed-41db-bd2d-e7d970217e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:44.723662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f162-73ed-41db-bd2d-e7d970217e7d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:44.723944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f162-73ed-41db-bd2d-e7d970217e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:44.724217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f162-73ed-41db-bd2d-e7d970217e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:44.797090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9f162-73ed-41db-bd2d-e7d970217e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:44.798615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9f162-73ed-41db-bd2d-e7d970217e7d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:44.832062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f39734-c92d-40aa-813f-161b84528043 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:44.832379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f39734-c92d-40aa-813f-161b84528043 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:44.832608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f39734-c92d-40aa-813f-161b84528043 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:44.834112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 105/218] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:44.841499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832f2c-443f-4fb1-be0e-98869dc70f67 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:44.842076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832f2c-443f-4fb1-be0e-98869dc70f67 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:44.842076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832f2c-443f-4fb1-be0e-98869dc70f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:44.863146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f9832f2c-443f-4fb1-be0e-98869dc70f67 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:44.864187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f9832f2c-443f-4fb1-be0e-98869dc70f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:44.889618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:44.916997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 114/219] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:44.924165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9f162-73ed-41db-bd2d-e7d970217e7d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:44.959876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 106/220] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:44.988014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9832f2c-443f-4fb1-be0e-98869dc70f67 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:45.042624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:45.046058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9f162-73ed-41db-bd2d-e7d970217e7d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:45.081943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf5bca-44d9-4ada-8e4b-f7bc30e61e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:45.083106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf5bca-44d9-4ada-8e4b-f7bc30e61e16 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:45.083526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf5bca-44d9-4ada-8e4b-f7bc30e61e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:45.083941 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf5bca-44d9-4ada-8e4b-f7bc30e61e16 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:45.085271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf5bca-44d9-4ada-8e4b-f7bc30e61e16 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:45.086870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf5bca-44d9-4ada-8e4b-f7bc30e61e16 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:45.089051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 115/221] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:44 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:45.096720 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf5bca-44d9-4ada-8e4b-f7bc30e61e16 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:45.130997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9832f2c-443f-4fb1-be0e-98869dc70f67 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:45.163693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e71cc7-5189-4d4d-ae01-f8eedc0820cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:45.164651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e71cc7-5189-4d4d-ae01-f8eedc0820cd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:45.165033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e71cc7-5189-4d4d-ae01-f8eedc0820cd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:45.165419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e71cc7-5189-4d4d-ae01-f8eedc0820cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:45.177316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e71cc7-5189-4d4d-ae01-f8eedc0820cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:45.182531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-73e71cc7-5189-4d4d-ae01-f8eedc0820cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:45.186042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:45.188368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:45.189233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 107/222] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:53:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:53:45.194274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e71cc7-5189-4d4d-ae01-f8eedc0820cd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:45.243510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf5bca-44d9-4ada-8e4b-f7bc30e61e16 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:45.287510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac05f3-d567-4458-8f30-541029c89d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:45.288165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac05f3-d567-4458-8f30-541029c89d08 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:45.288523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac05f3-d567-4458-8f30-541029c89d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:45.288719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac05f3-d567-4458-8f30-541029c89d08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:45.289546 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac05f3-d567-4458-8f30-541029c89d08 None admin] RBAC: Adding query filter params (role.id=bce93d0b549349079c3292eb120d54c1, scope.project.id=f89df535b56543e3b83b59bc617ffd14, user.id=1d32c41524b642788914b2f81c8c746c) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:45.289857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac05f3-d567-4458-8f30-541029c89d08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:45.291352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac05f3-d567-4458-8f30-541029c89d08 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:45.298891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 116/223] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:45 2022] GET /identity/v3/role_assignments?user.id=1d32c41524b642788914b2f81c8c746c&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=bce93d0b549349079c3292eb120d54c1 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:45.300348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd14cb-d3e8-4cc8-9152-cef3e2cf142d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:45.300733 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd14cb-d3e8-4cc8-9152-cef3e2cf142d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:45.301373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd14cb-d3e8-4cc8-9152-cef3e2cf142d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:45.302829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 117/224] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:45.308436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02251b-30ff-4ee9-8321-4602e88a1c55 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:45.309470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02251b-30ff-4ee9-8321-4602e88a1c55 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:45.310028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02251b-30ff-4ee9-8321-4602e88a1c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:45.336760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fd02251b-30ff-4ee9-8321-4602e88a1c55 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:45.338233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fd02251b-30ff-4ee9-8321-4602e88a1c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:45.352676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e71cc7-5189-4d4d-ae01-f8eedc0820cd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:45.354498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:45.431637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacdf9b-9a22-4729-9e2f-6047e5eb8458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:45.432234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacdf9b-9a22-4729-9e2f-6047e5eb8458 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:45.432518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacdf9b-9a22-4729-9e2f-6047e5eb8458 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:45.432797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacdf9b-9a22-4729-9e2f-6047e5eb8458 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:45.433628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacdf9b-9a22-4729-9e2f-6047e5eb8458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:45.435692 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacdf9b-9a22-4729-9e2f-6047e5eb8458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:45.437144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacdf9b-9a22-4729-9e2f-6047e5eb8458 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:45.444188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 118/225] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:45.447718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 108/226] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:45.453772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02251b-30ff-4ee9-8321-4602e88a1c55 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:45.495234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacdf9b-9a22-4729-9e2f-6047e5eb8458 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:45.536145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:45.620411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02251b-30ff-4ee9-8321-4602e88a1c55 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:45.662693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacdf9b-9a22-4729-9e2f-6047e5eb8458 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:45.695006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cc1d8-2055-446a-8bde-b3b31754d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:45.695822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cc1d8-2055-446a-8bde-b3b31754d0ac None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:45.696105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cc1d8-2055-446a-8bde-b3b31754d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:45.696379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cc1d8-2055-446a-8bde-b3b31754d0ac None admin] PATH_INFO: `/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:45.699091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cc1d8-2055-446a-8bde-b3b31754d0ac None admin] RBAC: Authorizing `identity:get_user(user_id=3f5f487a07cc4589a4506fcd8fdf50c7)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:45.701503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cc1d8-2055-446a-8bde-b3b31754d0ac None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:45.703373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd1bcb-2a15-43ef-9c6a-a9e3165d7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:45.704183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd1bcb-2a15-43ef-9c6a-a9e3165d7de4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:45.704461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd1bcb-2a15-43ef-9c6a-a9e3165d7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:45.704731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd1bcb-2a15-43ef-9c6a-a9e3165d7de4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:45.705847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 119/227] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:45 2022] GET /identity/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:45.716116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cc1d8-2055-446a-8bde-b3b31754d0ac None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:45.730065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd1bcb-2a15-43ef-9c6a-a9e3165d7de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-abdd1bcb-2a15-43ef-9c6a-a9e3165d7de4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:45.740727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:45.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:45.742381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 109/228] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:53:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:53:45.748325 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd1bcb-2a15-43ef-9c6a-a9e3165d7de4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:45.779141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:45.855226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd1bcb-2a15-43ef-9c6a-a9e3165d7de4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:45.893806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f619c07-dd44-45a6-b1e0-594a60ba328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:45.894475 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619c07-dd44-45a6-b1e0-594a60ba328f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:45.894959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619c07-dd44-45a6-b1e0-594a60ba328f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:45.895241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619c07-dd44-45a6-b1e0-594a60ba328f None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:45.895992 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f619c07-dd44-45a6-b1e0-594a60ba328f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:45.896300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f619c07-dd44-45a6-b1e0-594a60ba328f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:45.897677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f619c07-dd44-45a6-b1e0-594a60ba328f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:45.907500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 110/229] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:53:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:45.913087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f619c07-dd44-45a6-b1e0-594a60ba328f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:46.015164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:46.023691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f619c07-dd44-45a6-b1e0-594a60ba328f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:46.065810 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e71bf-116f-4943-94fc-2e9fcf02a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:46.066687 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e71bf-116f-4943-94fc-2e9fcf02a367 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:46.066993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e71bf-116f-4943-94fc-2e9fcf02a367 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:46.067272 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e71bf-116f-4943-94fc-2e9fcf02a367 None admin] PATH_INFO: `/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:46.071531 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e71bf-116f-4943-94fc-2e9fcf02a367 None admin] RBAC: Authorizing `identity:get_user(user_id=3f5f487a07cc4589a4506fcd8fdf50c7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:46.072997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e71bf-116f-4943-94fc-2e9fcf02a367 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:46.075517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 111/230] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:45 2022] GET /identity/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:46.086436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e71bf-116f-4943-94fc-2e9fcf02a367 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:46.099488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cc1d8-2055-446a-8bde-b3b31754d0ac None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:46.115066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:46.171097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643f621-3b71-440b-99f5-010b7d71d670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:46.171994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643f621-3b71-440b-99f5-010b7d71d670 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:46.172274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643f621-3b71-440b-99f5-010b7d71d670 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:46.172545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643f621-3b71-440b-99f5-010b7d71d670 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:46.173891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643f621-3b71-440b-99f5-010b7d71d670 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:46.175409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643f621-3b71-440b-99f5-010b7d71d670 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:46.177797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 120/231] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:45 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:46.184063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643f621-3b71-440b-99f5-010b7d71d670 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:46.297667 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643f621-3b71-440b-99f5-010b7d71d670 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:46.333919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c0746-3986-47c4-a757-e9d093ca1a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:46.334848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c0746-3986-47c4-a757-e9d093ca1a47 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:46.335273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c0746-3986-47c4-a757-e9d093ca1a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:46.335562 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c0746-3986-47c4-a757-e9d093ca1a47 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14/users/3f5f487a07cc4589a4506fcd8fdf50c7/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:46.337702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c0746-3986-47c4-a757-e9d093ca1a47 None admin] RBAC: Authorizing `identity:create_grant(project_id=f89df535b56543e3b83b59bc617ffd14, user_id=3f5f487a07cc4589a4506fcd8fdf50c7, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:46.339205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c0746-3986-47c4-a757-e9d093ca1a47 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:46.352534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e71bf-116f-4943-94fc-2e9fcf02a367 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:46.355006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 121/232] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:53:46 2022] PUT /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14/users/3f5f487a07cc4589a4506fcd8fdf50c7/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:53:46.404553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f2e5-d169-469b-b375-44f6cb62e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:46.405504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f2e5-d169-469b-b375-44f6cb62e415 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:46.405792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f2e5-d169-469b-b375-44f6cb62e415 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:46.406068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f2e5-d169-469b-b375-44f6cb62e415 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:46.407394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f2e5-d169-469b-b375-44f6cb62e415 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:46.408921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f2e5-d169-469b-b375-44f6cb62e415 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:46.411300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 112/233] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:46 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:46.416710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c0746-3986-47c4-a757-e9d093ca1a47 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:46.467743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:46.550680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c0746-3986-47c4-a757-e9d093ca1a47 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:46.588258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0af79-bcde-450b-9d4a-bf0d66b3cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:46.589168 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0af79-bcde-450b-9d4a-bf0d66b3cb88 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:46.589449 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0af79-bcde-450b-9d4a-bf0d66b3cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:46.589721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0af79-bcde-450b-9d4a-bf0d66b3cb88 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14/users/3f5f487a07cc4589a4506fcd8fdf50c7/roles/66b09c60197a4a1fb2cca5402bb83375` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:46.592985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0af79-bcde-450b-9d4a-bf0d66b3cb88 None admin] RBAC: Authorizing `identity:create_grant(project_id=f89df535b56543e3b83b59bc617ffd14, user_id=3f5f487a07cc4589a4506fcd8fdf50c7, role_id=66b09c60197a4a1fb2cca5402bb83375)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:46.594495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0af79-bcde-450b-9d4a-bf0d66b3cb88 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:46.616639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 122/234] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:53:46 2022] PUT /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14/users/3f5f487a07cc4589a4506fcd8fdf50c7/roles/66b09c60197a4a1fb2cca5402bb83375 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:53:47.432710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc256e0-ba12-45fe-ba1a-0edc94bfb922 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:47.433217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc256e0-ba12-45fe-ba1a-0edc94bfb922 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:47.433289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc256e0-ba12-45fe-ba1a-0edc94bfb922 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:47.434721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 113/235] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:47.439998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e17a24-17b8-4691-a545-763d9d381687 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:47.440422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e17a24-17b8-4691-a545-763d9d381687 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:47.440556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e17a24-17b8-4691-a545-763d9d381687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:47.462927 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d7e17a24-17b8-4691-a545-763d9d381687 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:47.464338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d7e17a24-17b8-4691-a545-763d9d381687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:47.566525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 123/236] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:47.602225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc256e0-ba12-45fe-ba1a-0edc94bfb922 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:47.633479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:47.643662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56aa3-e419-4d75-9b90-36415d229a9b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:47.644453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56aa3-e419-4d75-9b90-36415d229a9b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:47.644955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56aa3-e419-4d75-9b90-36415d229a9b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:47.647239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 124/237] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:47.653968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae79bc6-aa13-4267-843a-8004c06d2bae None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:47.654508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae79bc6-aa13-4267-843a-8004c06d2bae None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:47.655022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae79bc6-aa13-4267-843a-8004c06d2bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:47.683524 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-eae79bc6-aa13-4267-843a-8004c06d2bae None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:47.684728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-eae79bc6-aa13-4267-843a-8004c06d2bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:47.731361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:47.786889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc256e0-ba12-45fe-ba1a-0edc94bfb922 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:47.825635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 125/238] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:47.853238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca9ae3-d8d7-4ab3-8928-a60c270c1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:47.854051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca9ae3-d8d7-4ab3-8928-a60c270c1cbf None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:47.854339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca9ae3-d8d7-4ab3-8928-a60c270c1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:47.854621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca9ae3-d8d7-4ab3-8928-a60c270c1cbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:47.873572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca9ae3-d8d7-4ab3-8928-a60c270c1cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f1ca9ae3-d8d7-4ab3-8928-a60c270c1cbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:47.881657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:47.882631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:47.883471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:47.888516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 114/239] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:47.891375 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae79bc6-aa13-4267-843a-8004c06d2bae None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:47.902785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca9ae3-d8d7-4ab3-8928-a60c270c1cbf None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:48.023832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:48.033709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae79bc6-aa13-4267-843a-8004c06d2bae None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:48.047476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca9ae3-d8d7-4ab3-8928-a60c270c1cbf None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:48.078940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278f776-5591-4b37-9b79-72cda678252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:48.079731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278f776-5591-4b37-9b79-72cda678252c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:48.080008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278f776-5591-4b37-9b79-72cda678252c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:48.080278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278f776-5591-4b37-9b79-72cda678252c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:48.081435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278f776-5591-4b37-9b79-72cda678252c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:48.082896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278f776-5591-4b37-9b79-72cda678252c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:48.084807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 126/240] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:48.085998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc417724-fd0a-4e43-b033-76a2f5578a3b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:48.086274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc417724-fd0a-4e43-b033-76a2f5578a3b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:48.086545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc417724-fd0a-4e43-b033-76a2f5578a3b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:48.087801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 127/241] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:48.093642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4481c3-665d-43ac-966c-c0d45b4af18a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:48.093902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4481c3-665d-43ac-966c-c0d45b4af18a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:48.094173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4481c3-665d-43ac-966c-c0d45b4af18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:48.097035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b79f0-a78b-4b6a-8217-4d7c41e5dc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:48.097713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b79f0-a78b-4b6a-8217-4d7c41e5dc62 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:48.098059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b79f0-a78b-4b6a-8217-4d7c41e5dc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:48.098344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b79f0-a78b-4b6a-8217-4d7c41e5dc62 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:48.099440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b79f0-a78b-4b6a-8217-4d7c41e5dc62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:48.099777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b79f0-a78b-4b6a-8217-4d7c41e5dc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:48.102092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b79f0-a78b-4b6a-8217-4d7c41e5dc62 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:48.112428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6a4481c3-665d-43ac-966c-c0d45b4af18a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:48.113606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 115/242] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:48.113888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6a4481c3-665d-43ac-966c-c0d45b4af18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:48.114404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b79f0-a78b-4b6a-8217-4d7c41e5dc62 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:48.134347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:48.197678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 128/243] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:48.207122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4481c3-665d-43ac-966c-c0d45b4af18a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:48.242300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b79f0-a78b-4b6a-8217-4d7c41e5dc62 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:48.282105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a9afb-856a-4101-94f3-2c93e65b97dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:48.282870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a9afb-856a-4101-94f3-2c93e65b97dc None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:48.283253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a9afb-856a-4101-94f3-2c93e65b97dc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:48.283542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a9afb-856a-4101-94f3-2c93e65b97dc None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:48.284433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a9afb-856a-4101-94f3-2c93e65b97dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:48.286449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a9afb-856a-4101-94f3-2c93e65b97dc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:48.308332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:48.317434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 116/244] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:53:48 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:48.323583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a9afb-856a-4101-94f3-2c93e65b97dc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:48.341563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4481c3-665d-43ac-966c-c0d45b4af18a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:48.415931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84e8a8-e0aa-41f4-bfdf-61182fd02cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:48.416818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84e8a8-e0aa-41f4-bfdf-61182fd02cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:48.417095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84e8a8-e0aa-41f4-bfdf-61182fd02cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:48.417433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84e8a8-e0aa-41f4-bfdf-61182fd02cd6 None admin] PATH_INFO: `/v3/users/a0ada9b94ff741b3b267d5ada4ac3192` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:48.443345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84e8a8-e0aa-41f4-bfdf-61182fd02cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=a0ada9b94ff741b3b267d5ada4ac3192)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:48.444823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84e8a8-e0aa-41f4-bfdf-61182fd02cd6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:48.446833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 129/245] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:48 2022] GET /identity/v3/users/a0ada9b94ff741b3b267d5ada4ac3192 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:48.452888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84e8a8-e0aa-41f4-bfdf-61182fd02cd6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:48.473780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:48.543773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a9afb-856a-4101-94f3-2c93e65b97dc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:48.600968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe8f78-e8ee-46cf-80bd-2f7cb8d2c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:48.601775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe8f78-e8ee-46cf-80bd-2f7cb8d2c5ed None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:48.602055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe8f78-e8ee-46cf-80bd-2f7cb8d2c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:48.602327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe8f78-e8ee-46cf-80bd-2f7cb8d2c5ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:48.614812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe8f78-e8ee-46cf-80bd-2f7cb8d2c5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-64fe8f78-e8ee-46cf-80bd-2f7cb8d2c5ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:48.623781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:48.624693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:48.626204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 117/246] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:48.627581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84e8a8-e0aa-41f4-bfdf-61182fd02cd6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:48.631331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe8f78-e8ee-46cf-80bd-2f7cb8d2c5ed None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:48.665116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d956d85-c617-4c82-b526-9413f17d58ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:48.666133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d956d85-c617-4c82-b526-9413f17d58ce None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:48.666642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d956d85-c617-4c82-b526-9413f17d58ce None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:48.667148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d956d85-c617-4c82-b526-9413f17d58ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:48.699878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:48.746202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d956d85-c617-4c82-b526-9413f17d58ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:48.748087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d956d85-c617-4c82-b526-9413f17d58ce None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:48.749278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe8f78-e8ee-46cf-80bd-2f7cb8d2c5ed None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:48.760517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:48.789273 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532ecf6-3947-4d5b-81da-d3b08cfaba44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:48.789940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532ecf6-3947-4d5b-81da-d3b08cfaba44 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:48.790221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532ecf6-3947-4d5b-81da-d3b08cfaba44 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:48.790500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532ecf6-3947-4d5b-81da-d3b08cfaba44 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:48.791283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532ecf6-3947-4d5b-81da-d3b08cfaba44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:48.791586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532ecf6-3947-4d5b-81da-d3b08cfaba44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:48.793644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532ecf6-3947-4d5b-81da-d3b08cfaba44 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:48.803313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 118/247] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:48.808605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532ecf6-3947-4d5b-81da-d3b08cfaba44 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:48.862209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 130/248] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:53:48.866120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d956d85-c617-4c82-b526-9413f17d58ce None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:48.925087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532ecf6-3947-4d5b-81da-d3b08cfaba44 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:48.951334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:48.964838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44034727-0ccf-46c8-9256-90b9a40518f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:48.966067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44034727-0ccf-46c8-9256-90b9a40518f1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:48.966350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44034727-0ccf-46c8-9256-90b9a40518f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:48.966621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44034727-0ccf-46c8-9256-90b9a40518f1 None admin] PATH_INFO: `/v3/users/1d32c41524b642788914b2f81c8c746c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:48.967879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44034727-0ccf-46c8-9256-90b9a40518f1 None admin] RBAC: Authorizing `identity:get_user(user_id=1d32c41524b642788914b2f81c8c746c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:48.969451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44034727-0ccf-46c8-9256-90b9a40518f1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:48.971226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 119/249] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:48 2022] GET /identity/v3/users/1d32c41524b642788914b2f81c8c746c => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:48.976620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44034727-0ccf-46c8-9256-90b9a40518f1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:48.987211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d956d85-c617-4c82-b526-9413f17d58ce None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:49.001890 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:49.031770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524448-fcab-408e-89ca-979b10bf13c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:49.033009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524448-fcab-408e-89ca-979b10bf13c5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.033499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524448-fcab-408e-89ca-979b10bf13c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.034031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524448-fcab-408e-89ca-979b10bf13c5 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.035732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95524448-fcab-408e-89ca-979b10bf13c5 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:49.037691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95524448-fcab-408e-89ca-979b10bf13c5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:49.040233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 131/250] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:48 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:49.046640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524448-fcab-408e-89ca-979b10bf13c5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:49.102969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44034727-0ccf-46c8-9256-90b9a40518f1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:49.145560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5bd73-08cb-48ff-b8b0-9a46c2315b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:49.146495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5bd73-08cb-48ff-b8b0-9a46c2315b79 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.146825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5bd73-08cb-48ff-b8b0-9a46c2315b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.147580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5bd73-08cb-48ff-b8b0-9a46c2315b79 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.148816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5bd73-08cb-48ff-b8b0-9a46c2315b79 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:49.150286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5bd73-08cb-48ff-b8b0-9a46c2315b79 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:49.152982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 120/251] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:48 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:49.154676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582764c-8931-44a3-b139-1460f15d24db None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.155000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582764c-8931-44a3-b139-1460f15d24db None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.155283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582764c-8931-44a3-b139-1460f15d24db None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.157260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 121/252] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:49.162048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582764c-8931-44a3-b139-1460f15d24db None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:49.187794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524448-fcab-408e-89ca-979b10bf13c5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:49.238475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606d814-c88d-46b0-a9f3-b3e4ab7d24ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:49.238963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606d814-c88d-46b0-a9f3-b3e4ab7d24ef None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.239242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606d814-c88d-46b0-a9f3-b3e4ab7d24ef None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.239514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606d814-c88d-46b0-a9f3-b3e4ab7d24ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.240350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606d814-c88d-46b0-a9f3-b3e4ab7d24ef None admin] RBAC: Adding query filter params (role.id=ddd16047c21a4707886ce223206a83de, scope.project.id=f89df535b56543e3b83b59bc617ffd14, user.id=a0ada9b94ff741b3b267d5ada4ac3192) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:49.240655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606d814-c88d-46b0-a9f3-b3e4ab7d24ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:49.242632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606d814-c88d-46b0-a9f3-b3e4ab7d24ef None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:49.248274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:49.249431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 132/253] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:49 2022] GET /identity/v3/role_assignments?user.id=a0ada9b94ff741b3b267d5ada4ac3192&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=ddd16047c21a4707886ce223206a83de => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:49.250630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3a671-9272-4675-9a90-63947fe8f4e0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.250999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3a671-9272-4675-9a90-63947fe8f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.251244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3a671-9272-4675-9a90-63947fe8f4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.270106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-86e3a671-9272-4675-9a90-63947fe8f4e0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:49.271357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-86e3a671-9272-4675-9a90-63947fe8f4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:49.309229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582764c-8931-44a3-b139-1460f15d24db None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:49.313959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:49.350257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 133/254] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:49.351679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f94df-177f-416a-8b14-2d35ab8af59f None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.351964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f94df-177f-416a-8b14-2d35ab8af59f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.352162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e6e42-0a9b-4c04-8b6a-1b03a1d273cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:49.352279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f94df-177f-416a-8b14-2d35ab8af59f None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.353570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 134/255] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:49.353845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6e42-0a9b-4c04-8b6a-1b03a1d273cb None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.354332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6e42-0a9b-4c04-8b6a-1b03a1d273cb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.359268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6e42-0a9b-4c04-8b6a-1b03a1d273cb None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14/users/1d32c41524b642788914b2f81c8c746c/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.362169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e6e42-0a9b-4c04-8b6a-1b03a1d273cb None admin] RBAC: Authorizing `identity:create_grant(project_id=f89df535b56543e3b83b59bc617ffd14, user_id=1d32c41524b642788914b2f81c8c746c, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:49.364753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e6e42-0a9b-4c04-8b6a-1b03a1d273cb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:49.372755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba7da-5441-495b-a929-af56089648fa None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.372968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba7da-5441-495b-a929-af56089648fa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.373185 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba7da-5441-495b-a929-af56089648fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.384262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 122/256] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:53:49 2022] PUT /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14/users/1d32c41524b642788914b2f81c8c746c/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:53:49.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e6e42-0a9b-4c04-8b6a-1b03a1d273cb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:49.398927 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-56bba7da-5441-495b-a929-af56089648fa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:49.400111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-56bba7da-5441-495b-a929-af56089648fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:49.473676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 135/257] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:49.516361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bba7da-5441-495b-a929-af56089648fa None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:49.644763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e6e42-0a9b-4c04-8b6a-1b03a1d273cb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:49.663646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bba7da-5441-495b-a929-af56089648fa None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:49.665357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:49.692426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:49.719993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491426d7-d377-4845-89d6-9b09b2a14930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:49.720817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491426d7-d377-4845-89d6-9b09b2a14930 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.721105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491426d7-d377-4845-89d6-9b09b2a14930 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.721391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491426d7-d377-4845-89d6-9b09b2a14930 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.732660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491426d7-d377-4845-89d6-9b09b2a14930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:49.735457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ebaea-10f0-452b-8226-b05baebe84d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:49.736277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ebaea-10f0-452b-8226-b05baebe84d8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.736565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ebaea-10f0-452b-8226-b05baebe84d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.736842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ebaea-10f0-452b-8226-b05baebe84d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-491426d7-d377-4845-89d6-9b09b2a14930 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:49.740906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:49.741783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:49.742575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 136/258] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:53:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:49.748799 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491426d7-d377-4845-89d6-9b09b2a14930 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:49.775685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ebaea-10f0-452b-8226-b05baebe84d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3b4ebaea-10f0-452b-8226-b05baebe84d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:49.788259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:49.790402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:49.792446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 123/259] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:53:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:49.799700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ebaea-10f0-452b-8226-b05baebe84d8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:49.864875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491426d7-d377-4845-89d6-9b09b2a14930 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:49.903243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c6733-3ccb-4269-89b2-a17ae0ed185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:49.903945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c6733-3ccb-4269-89b2-a17ae0ed185e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.904233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c6733-3ccb-4269-89b2-a17ae0ed185e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.904513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c6733-3ccb-4269-89b2-a17ae0ed185e None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.905563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c6733-3ccb-4269-89b2-a17ae0ed185e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:49.905979 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c6733-3ccb-4269-89b2-a17ae0ed185e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:49.907593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c6733-3ccb-4269-89b2-a17ae0ed185e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:49.921126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 137/260] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:53:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:49.922930 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c6733-3ccb-4269-89b2-a17ae0ed185e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:49.954020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ebaea-10f0-452b-8226-b05baebe84d8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:49.967821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:49.989056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dbbf6-b105-481a-b5f0-6e306b2dd7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:49.989729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dbbf6-b105-481a-b5f0-6e306b2dd7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:49.990012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dbbf6-b105-481a-b5f0-6e306b2dd7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:49.990289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dbbf6-b105-481a-b5f0-6e306b2dd7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:49.991068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dbbf6-b105-481a-b5f0-6e306b2dd7e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:49.991380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dbbf6-b105-481a-b5f0-6e306b2dd7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:49.992813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dbbf6-b105-481a-b5f0-6e306b2dd7e2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:50.001546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 124/261] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:50.006733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dbbf6-b105-481a-b5f0-6e306b2dd7e2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:50.059188 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:50.111322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c6733-3ccb-4269-89b2-a17ae0ed185e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:50.147269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dbbf6-b105-481a-b5f0-6e306b2dd7e2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:50.182182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448726-7a1f-4bc5-8fb5-5c1d311f41ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:50.183017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448726-7a1f-4bc5-8fb5-5c1d311f41ed None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:50.183303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448726-7a1f-4bc5-8fb5-5c1d311f41ed None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:50.184125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448726-7a1f-4bc5-8fb5-5c1d311f41ed None admin] PATH_INFO: `/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:50.185557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4448726-7a1f-4bc5-8fb5-5c1d311f41ed None admin] RBAC: Authorizing `identity:get_user(user_id=3f5f487a07cc4589a4506fcd8fdf50c7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:50.187212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4448726-7a1f-4bc5-8fb5-5c1d311f41ed None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:50.189162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 125/262] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:50 2022] GET /identity/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:50.195368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448726-7a1f-4bc5-8fb5-5c1d311f41ed None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:50.219980 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e46410-040f-49ec-8ed1-9fc41e5b1dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:50.220866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e46410-040f-49ec-8ed1-9fc41e5b1dcc None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:50.221145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e46410-040f-49ec-8ed1-9fc41e5b1dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:50.221415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e46410-040f-49ec-8ed1-9fc41e5b1dcc None admin] PATH_INFO: `/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:50.223600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e46410-040f-49ec-8ed1-9fc41e5b1dcc None admin] RBAC: Authorizing `identity:get_user(user_id=3f5f487a07cc4589a4506fcd8fdf50c7)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:50.225065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e46410-040f-49ec-8ed1-9fc41e5b1dcc None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:50.227042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 138/263] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:49 2022] GET /identity/v3/users/3f5f487a07cc4589a4506fcd8fdf50c7 => generated 283 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:50.232521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e46410-040f-49ec-8ed1-9fc41e5b1dcc None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:50.301863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448726-7a1f-4bc5-8fb5-5c1d311f41ed None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:50.312157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:50.348482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7227c-7a9b-42ad-9f15-75b87e5b3249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:50.349672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7227c-7a9b-42ad-9f15-75b87e5b3249 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:50.350159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7227c-7a9b-42ad-9f15-75b87e5b3249 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:50.350719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7227c-7a9b-42ad-9f15-75b87e5b3249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:50.401059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:50.412853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e46410-040f-49ec-8ed1-9fc41e5b1dcc None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:50.428699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7227c-7a9b-42ad-9f15-75b87e5b3249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:50.430189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7227c-7a9b-42ad-9f15-75b87e5b3249 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:50.474157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7efc79-6e1b-4792-88ac-4bdf99f21bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:50.476130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7efc79-6e1b-4792-88ac-4bdf99f21bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:50.476777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7efc79-6e1b-4792-88ac-4bdf99f21bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:50.478345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7efc79-6e1b-4792-88ac-4bdf99f21bc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:50.624587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7efc79-6e1b-4792-88ac-4bdf99f21bc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:50.626095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7efc79-6e1b-4792-88ac-4bdf99f21bc6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:50.635915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 126/264] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:53:50.641886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7227c-7a9b-42ad-9f15-75b87e5b3249 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:50.660341 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:50.802385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:50.818694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 139/265] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:53:50.824280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7efc79-6e1b-4792-88ac-4bdf99f21bc6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:50.846533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7227c-7a9b-42ad-9f15-75b87e5b3249 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:50.886312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a90aec-c76f-4557-8216-64905362ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:50.887419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a90aec-c76f-4557-8216-64905362ccbd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:50.887641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a90aec-c76f-4557-8216-64905362ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:50.887913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a90aec-c76f-4557-8216-64905362ccbd None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:50.889152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a90aec-c76f-4557-8216-64905362ccbd None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:50.890601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a90aec-c76f-4557-8216-64905362ccbd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:50.893466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 127/266] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:50 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:50.904203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a90aec-c76f-4557-8216-64905362ccbd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:51.011971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7efc79-6e1b-4792-88ac-4bdf99f21bc6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:51.044558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:51.075556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a90aec-c76f-4557-8216-64905362ccbd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:51.079257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca64f5-549a-41f2-9f8c-a8969e1ae94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:51.080119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca64f5-549a-41f2-9f8c-a8969e1ae94c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:51.080402 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca64f5-549a-41f2-9f8c-a8969e1ae94c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:51.080674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca64f5-549a-41f2-9f8c-a8969e1ae94c None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:51.082488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca64f5-549a-41f2-9f8c-a8969e1ae94c None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:51.083997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca64f5-549a-41f2-9f8c-a8969e1ae94c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:51.085694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 140/267] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:50 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:51.092417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca64f5-549a-41f2-9f8c-a8969e1ae94c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:51.167417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241866d-e50e-4020-8ffd-a28b17fe5b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:51.168170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241866d-e50e-4020-8ffd-a28b17fe5b74 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:51.168457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241866d-e50e-4020-8ffd-a28b17fe5b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:51.168742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241866d-e50e-4020-8ffd-a28b17fe5b74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:51.169593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241866d-e50e-4020-8ffd-a28b17fe5b74 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=f89df535b56543e3b83b59bc617ffd14, user.id=3f5f487a07cc4589a4506fcd8fdf50c7) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:51.169911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241866d-e50e-4020-8ffd-a28b17fe5b74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:51.171426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241866d-e50e-4020-8ffd-a28b17fe5b74 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:51.176434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:51.180679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 128/268] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:50 2022] GET /identity/v3/role_assignments?user.id=3f5f487a07cc4589a4506fcd8fdf50c7&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=af8084c48e3c40298e26d44d6d14595a => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:51.236501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca64f5-549a-41f2-9f8c-a8969e1ae94c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:51.281504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1a320-ce52-4664-8cfe-172f3996424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:51.282181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1a320-ce52-4664-8cfe-172f3996424e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:51.282466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1a320-ce52-4664-8cfe-172f3996424e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:51.282761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1a320-ce52-4664-8cfe-172f3996424e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:51.283613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1a320-ce52-4664-8cfe-172f3996424e None admin] RBAC: Adding query filter params (role.id=66b09c60197a4a1fb2cca5402bb83375, scope.project.id=f89df535b56543e3b83b59bc617ffd14, user.id=3f5f487a07cc4589a4506fcd8fdf50c7) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:51.283926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1a320-ce52-4664-8cfe-172f3996424e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:51.285410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1a320-ce52-4664-8cfe-172f3996424e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:51.292344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 141/269] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:51 2022] GET /identity/v3/role_assignments?user.id=3f5f487a07cc4589a4506fcd8fdf50c7&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=66b09c60197a4a1fb2cca5402bb83375 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:51.916870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb9385-b7cf-4bde-a943-e51ca59db76b None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:51.918584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb9385-b7cf-4bde-a943-e51ca59db76b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:51.919106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb9385-b7cf-4bde-a943-e51ca59db76b None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:51.920801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 129/270] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:51.926783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228340d-4e0c-4a33-873f-886102db90a8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:51.927728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228340d-4e0c-4a33-873f-886102db90a8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:51.928231 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228340d-4e0c-4a33-873f-886102db90a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:51.947502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c228340d-4e0c-4a33-873f-886102db90a8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:51.949660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c228340d-4e0c-4a33-873f-886102db90a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:52.023273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 142/271] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:52.049023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb9385-b7cf-4bde-a943-e51ca59db76b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:52.131634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f58e86-7b0e-4732-85d3-b82c1db3b829 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.131952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f58e86-7b0e-4732-85d3-b82c1db3b829 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.132182 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f58e86-7b0e-4732-85d3-b82c1db3b829 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.133966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 143/272] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:52.139631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9635-f566-46d1-adad-a3d4023fa1aa None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.140178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9635-f566-46d1-adad-a3d4023fa1aa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.140653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9635-f566-46d1-adad-a3d4023fa1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.160132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-26da9635-f566-46d1-adad-a3d4023fa1aa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:52.161840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-26da9635-f566-46d1-adad-a3d4023fa1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:52.163944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb9385-b7cf-4bde-a943-e51ca59db76b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:52.210650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e790e8-b729-4906-be99-f119bdd9773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:52.211520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e790e8-b729-4906-be99-f119bdd9773d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.211803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e790e8-b729-4906-be99-f119bdd9773d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.212073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e790e8-b729-4906-be99-f119bdd9773d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.223393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:52.229779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e790e8-b729-4906-be99-f119bdd9773d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:52.243120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:52.243881 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 144/273] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-a8e790e8-b729-4906-be99-f119bdd9773d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:52.250833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:52.251745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:52.252522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 130/274] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:52.255245 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da9635-f566-46d1-adad-a3d4023fa1aa None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:52.279273 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e790e8-b729-4906-be99-f119bdd9773d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:52.367674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da9635-f566-46d1-adad-a3d4023fa1aa None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:52.406446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e790e8-b729-4906-be99-f119bdd9773d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:52.412435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27667bd4-25a6-4c03-86f6-81023b48af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:52.413101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27667bd4-25a6-4c03-86f6-81023b48af9f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.413380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27667bd4-25a6-4c03-86f6-81023b48af9f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.414154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27667bd4-25a6-4c03-86f6-81023b48af9f None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.415023 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27667bd4-25a6-4c03-86f6-81023b48af9f None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:52.415331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27667bd4-25a6-4c03-86f6-81023b48af9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:52.417585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27667bd4-25a6-4c03-86f6-81023b48af9f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:52.430863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 145/275] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:52.432201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb7afd-97f5-4088-944a-385174d656f5 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.432495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb7afd-97f5-4088-944a-385174d656f5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.432774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb7afd-97f5-4088-944a-385174d656f5 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.434990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 146/276] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:52.435684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb7afd-97f5-4088-944a-385174d656f5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:52.448672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5090f5c-ecf8-4a26-aa5c-0b6793832b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:52.450017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090f5c-ecf8-4a26-aa5c-0b6793832b95 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.450464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090f5c-ecf8-4a26-aa5c-0b6793832b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.450771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090f5c-ecf8-4a26-aa5c-0b6793832b95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.452161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5090f5c-ecf8-4a26-aa5c-0b6793832b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:52.453616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5090f5c-ecf8-4a26-aa5c-0b6793832b95 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:52.455496 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 131/277] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:52.456623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07633b-b8d6-4198-9493-c821d139dd07 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.456903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07633b-b8d6-4198-9493-c821d139dd07 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.457173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07633b-b8d6-4198-9493-c821d139dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.474851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1f07633b-b8d6-4198-9493-c821d139dd07 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:52.475993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1f07633b-b8d6-4198-9493-c821d139dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:52.488582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:52.547879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb7afd-97f5-4088-944a-385174d656f5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:52.549849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:52.563214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 132/278] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:52.564636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07633b-b8d6-4198-9493-c821d139dd07 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:52.586353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e406066-1442-4ba8-87a7-bd7b3bef46aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:52.587602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e406066-1442-4ba8-87a7-bd7b3bef46aa None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.587927 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e406066-1442-4ba8-87a7-bd7b3bef46aa None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.588205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e406066-1442-4ba8-87a7-bd7b3bef46aa None admin] PATH_INFO: `/v3/users/63d0a976b58e4406ba07fb9ed287f3e1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.605007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e406066-1442-4ba8-87a7-bd7b3bef46aa None admin] RBAC: Authorizing `identity:get_user(user_id=63d0a976b58e4406ba07fb9ed287f3e1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:52.607164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e406066-1442-4ba8-87a7-bd7b3bef46aa None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:52.613425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 147/279] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:52 2022] GET /identity/v3/users/63d0a976b58e4406ba07fb9ed287f3e1 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:52.613425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e406066-1442-4ba8-87a7-bd7b3bef46aa None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:52.682251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07633b-b8d6-4198-9493-c821d139dd07 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:52.718829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf35642-0281-4851-aae8-0c4598422011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:52.719864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf35642-0281-4851-aae8-0c4598422011 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.720363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf35642-0281-4851-aae8-0c4598422011 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.720571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e406066-1442-4ba8-87a7-bd7b3bef46aa None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:52.721035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf35642-0281-4851-aae8-0c4598422011 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.721944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf35642-0281-4851-aae8-0c4598422011 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:52.723489 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf35642-0281-4851-aae8-0c4598422011 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:52.723836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:52.744874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 133/280] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:53:52 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:52.746505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf35642-0281-4851-aae8-0c4598422011 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:52.775929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc55b-b673-42cc-96d0-2e7341f5dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:52.778232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc55b-b673-42cc-96d0-2e7341f5dc0a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.778837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc55b-b673-42cc-96d0-2e7341f5dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.779289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc55b-b673-42cc-96d0-2e7341f5dc0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.795189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc55b-b673-42cc-96d0-2e7341f5dc0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-625dc55b-b673-42cc-96d0-2e7341f5dc0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:52.805988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:52.807036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:52.807855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:52.811223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 148/281] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:52.817108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc55b-b673-42cc-96d0-2e7341f5dc0a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:52.818288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:52.874640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf35642-0281-4851-aae8-0c4598422011 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:52.915768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e37a2-2ad8-4f0c-b751-72f3fae94e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:52.916448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e37a2-2ad8-4f0c-b751-72f3fae94e5e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.916734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e37a2-2ad8-4f0c-b751-72f3fae94e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.917012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e37a2-2ad8-4f0c-b751-72f3fae94e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.917900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e37a2-2ad8-4f0c-b751-72f3fae94e5e None admin] RBAC: Adding query filter params (role.id=bce93d0b549349079c3292eb120d54c1, user.id=63d0a976b58e4406ba07fb9ed287f3e1, scope.system=all) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:52.918283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e37a2-2ad8-4f0c-b751-72f3fae94e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:52.919866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e37a2-2ad8-4f0c-b751-72f3fae94e5e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:52.930729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 134/282] 10.222.0.30 () {56 vars in 1308 bytes} [Mon May 23 17:53:52 2022] GET /identity/v3/role_assignments?user.id=63d0a976b58e4406ba07fb9ed287f3e1&scope.system=all&role.id=bce93d0b549349079c3292eb120d54c1 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:52.930729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d2ee6-7402-4f13-91ca-65cd73d1c4f9 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.930729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d2ee6-7402-4f13-91ca-65cd73d1c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.930729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d2ee6-7402-4f13-91ca-65cd73d1c4f9 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.930729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 135/283] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:52.940481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb52d-eed4-4fd6-8243-c848a20801ab None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:52.940764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb52d-eed4-4fd6-8243-c848a20801ab None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:52.941043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb52d-eed4-4fd6-8243-c848a20801ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:52.967809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3dcdb52d-eed4-4fd6-8243-c848a20801ab None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:52.969379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3dcdb52d-eed4-4fd6-8243-c848a20801ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:52.970008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc55b-b673-42cc-96d0-2e7341f5dc0a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:53.013016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803147d-b82b-4e11-8ed2-7bd93a232d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:53.014623 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803147d-b82b-4e11-8ed2-7bd93a232d94 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:53.018596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803147d-b82b-4e11-8ed2-7bd93a232d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:53.018596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803147d-b82b-4e11-8ed2-7bd93a232d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:53.018596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803147d-b82b-4e11-8ed2-7bd93a232d94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:53.018596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803147d-b82b-4e11-8ed2-7bd93a232d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:53.019618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803147d-b82b-4e11-8ed2-7bd93a232d94 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:53.036251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 149/284] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:53.038273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803147d-b82b-4e11-8ed2-7bd93a232d94 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:53.063524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 136/285] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:53.079470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:53.086628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdb52d-eed4-4fd6-8243-c848a20801ab None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:53.173238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:53.178314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803147d-b82b-4e11-8ed2-7bd93a232d94 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:53.219742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcf335-89b4-4814-b822-7248d5bea7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:53.220636 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf335-89b4-4814-b822-7248d5bea7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:53.220885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf335-89b4-4814-b822-7248d5bea7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:53.221160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf335-89b4-4814-b822-7248d5bea7d6 None admin] PATH_INFO: `/v3/users/a0ada9b94ff741b3b267d5ada4ac3192` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:53.222356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcf335-89b4-4814-b822-7248d5bea7d6 None admin] RBAC: Authorizing `identity:get_user(user_id=a0ada9b94ff741b3b267d5ada4ac3192)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:53.223848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcf335-89b4-4814-b822-7248d5bea7d6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:53.225770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 150/286] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:53 2022] GET /identity/v3/users/a0ada9b94ff741b3b267d5ada4ac3192 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:53.231924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcf335-89b4-4814-b822-7248d5bea7d6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:53.243855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdb52d-eed4-4fd6-8243-c848a20801ab None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:53.302429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e782-3a5e-478e-acde-e4af454df425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:53.303185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e782-3a5e-478e-acde-e4af454df425 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:53.303467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e782-3a5e-478e-acde-e4af454df425 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:53.303741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e782-3a5e-478e-acde-e4af454df425 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:53.326293 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e782-3a5e-478e-acde-e4af454df425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3be8e782-3a5e-478e-acde-e4af454df425 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:53.335745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:53.336682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:53.337473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:53:53.343940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 137/287] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:53:53.348842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e782-3a5e-478e-acde-e4af454df425 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:53.401890 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:53.418754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcf335-89b4-4814-b822-7248d5bea7d6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:53.480987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaafa8e-66ca-4eb9-b954-cbf309ccb645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:53.481858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafa8e-66ca-4eb9-b954-cbf309ccb645 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:53.482144 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafa8e-66ca-4eb9-b954-cbf309ccb645 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:53.482424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaafa8e-66ca-4eb9-b954-cbf309ccb645 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:53.484873 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaafa8e-66ca-4eb9-b954-cbf309ccb645 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:53.486371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaafa8e-66ca-4eb9-b954-cbf309ccb645 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:53.488479 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 151/288] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:53 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:53.509939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaafa8e-66ca-4eb9-b954-cbf309ccb645 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:53.547582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e782-3a5e-478e-acde-e4af454df425 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:53.564733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:53.600135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d1969-01c1-4a5c-8b23-ced9f9349513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:53.600811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d1969-01c1-4a5c-8b23-ced9f9349513 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:53.601097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d1969-01c1-4a5c-8b23-ced9f9349513 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:53.601371 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d1969-01c1-4a5c-8b23-ced9f9349513 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:53.602128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d1969-01c1-4a5c-8b23-ced9f9349513 None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:53.602436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d1969-01c1-4a5c-8b23-ced9f9349513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:53.605060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d1969-01c1-4a5c-8b23-ced9f9349513 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:53.621060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 138/289] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:53.626782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d1969-01c1-4a5c-8b23-ced9f9349513 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:53.663792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaafa8e-66ca-4eb9-b954-cbf309ccb645 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:53.700495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced97cef-1be3-44ab-bcad-c49467e31296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:53.701751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced97cef-1be3-44ab-bcad-c49467e31296 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:53.702235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced97cef-1be3-44ab-bcad-c49467e31296 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:53.702725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced97cef-1be3-44ab-bcad-c49467e31296 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14/users/a0ada9b94ff741b3b267d5ada4ac3192/roles/ddd16047c21a4707886ce223206a83de` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:53.704896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced97cef-1be3-44ab-bcad-c49467e31296 None admin] RBAC: Authorizing `identity:create_grant(project_id=f89df535b56543e3b83b59bc617ffd14, user_id=a0ada9b94ff741b3b267d5ada4ac3192, role_id=ddd16047c21a4707886ce223206a83de)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:53.706520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced97cef-1be3-44ab-bcad-c49467e31296 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:53.744973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 152/290] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:53:53 2022] PUT /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14/users/a0ada9b94ff741b3b267d5ada4ac3192/roles/ddd16047c21a4707886ce223206a83de => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:53:53.788822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d1969-01c1-4a5c-8b23-ced9f9349513 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:53.827075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8f40d-2969-4d3c-af66-38fa44eccf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:53.827884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8f40d-2969-4d3c-af66-38fa44eccf3d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:53.828166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8f40d-2969-4d3c-af66-38fa44eccf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:53.828443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8f40d-2969-4d3c-af66-38fa44eccf3d None admin] PATH_INFO: `/v3/users/1d32c41524b642788914b2f81c8c746c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:53.829719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8f40d-2969-4d3c-af66-38fa44eccf3d None admin] RBAC: Authorizing `identity:get_user(user_id=1d32c41524b642788914b2f81c8c746c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:53.831236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8f40d-2969-4d3c-af66-38fa44eccf3d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:53.833250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 139/291] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:53 2022] GET /identity/v3/users/1d32c41524b642788914b2f81c8c746c => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:53.838635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced97cef-1be3-44ab-bcad-c49467e31296 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:53.882478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:53.970092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced97cef-1be3-44ab-bcad-c49467e31296 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:54.005339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d938af9-e643-40ae-9c03-e40e6b59ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:54.006323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d938af9-e643-40ae-9c03-e40e6b59ecdc None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:54.006856 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d938af9-e643-40ae-9c03-e40e6b59ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:54.007343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d938af9-e643-40ae-9c03-e40e6b59ecdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:54.077653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d938af9-e643-40ae-9c03-e40e6b59ecdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:54.079451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d938af9-e643-40ae-9c03-e40e6b59ecdc None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:54.107065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:54.182091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 153/292] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:54.187540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8f40d-2969-4d3c-af66-38fa44eccf3d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:54.267132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:54.343391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8f40d-2969-4d3c-af66-38fa44eccf3d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:54.378214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe2798-85ea-4ad5-a6d4-d28846b9b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:54.379117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe2798-85ea-4ad5-a6d4-d28846b9b211 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:54.379392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe2798-85ea-4ad5-a6d4-d28846b9b211 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:54.379668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe2798-85ea-4ad5-a6d4-d28846b9b211 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:54.380874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe2798-85ea-4ad5-a6d4-d28846b9b211 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:54.382316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe2798-85ea-4ad5-a6d4-d28846b9b211 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:54.384625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 140/293] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:54 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:54.390893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d938af9-e643-40ae-9c03-e40e6b59ecdc None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:54.540495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d938af9-e643-40ae-9c03-e40e6b59ecdc None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:54.564280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:54.576000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbd8f2-6839-4848-aaa3-29e3966b344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:54.576654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbd8f2-6839-4848-aaa3-29e3966b344d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:54.576938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbd8f2-6839-4848-aaa3-29e3966b344d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:54.577213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbd8f2-6839-4848-aaa3-29e3966b344d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:54.578037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbd8f2-6839-4848-aaa3-29e3966b344d None admin] RBAC: Adding query filter params (role.id=bce93d0b549349079c3292eb120d54c1, scope.project.id=f89df535b56543e3b83b59bc617ffd14, user.id=1d32c41524b642788914b2f81c8c746c) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:54.578344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbd8f2-6839-4848-aaa3-29e3966b344d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:54.579805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbd8f2-6839-4848-aaa3-29e3966b344d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:54.586098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 154/294] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:54 2022] GET /identity/v3/role_assignments?user.id=1d32c41524b642788914b2f81c8c746c&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=bce93d0b549349079c3292eb120d54c1 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:55.495079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172b3c2-49fd-4af4-ae58-70a9747987f4 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:55.495590 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172b3c2-49fd-4af4-ae58-70a9747987f4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:55.495664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172b3c2-49fd-4af4-ae58-70a9747987f4 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:55.498034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 141/295] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:55.503560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95acbf1-9f82-4279-adf7-634caf82b534 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:55.504003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95acbf1-9f82-4279-adf7-634caf82b534 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:55.504145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95acbf1-9f82-4279-adf7-634caf82b534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:55.528240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f95acbf1-9f82-4279-adf7-634caf82b534 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:55.529434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f95acbf1-9f82-4279-adf7-634caf82b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:55.560651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7faab-57fd-4f4f-8ac3-6c78b1eb2576 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:55.561254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7faab-57fd-4f4f-8ac3-6c78b1eb2576 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:55.561733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7faab-57fd-4f4f-8ac3-6c78b1eb2576 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:55.563597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 142/296] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:55.571977 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86620-f098-4352-b316-8c1a5dce3136 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:55.572645 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86620-f098-4352-b316-8c1a5dce3136 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:55.573148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86620-f098-4352-b316-8c1a5dce3136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:55.596421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d3b86620-f098-4352-b316-8c1a5dce3136 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:55.597993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d3b86620-f098-4352-b316-8c1a5dce3136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:55.599565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 155/297] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:55.615291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701358e-5b7b-429c-aba8-8d81638c7701 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:55.615786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701358e-5b7b-429c-aba8-8d81638c7701 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:55.616215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701358e-5b7b-429c-aba8-8d81638c7701 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:55.619449 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 156/298] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:55.621947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701358e-5b7b-429c-aba8-8d81638c7701 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:55.672581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 143/299] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:53:55.674538 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8488-8247-4070-90bd-f636d8bd2b8d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:55.674861 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8488-8247-4070-90bd-f636d8bd2b8d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:55.675145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8488-8247-4070-90bd-f636d8bd2b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:55.697702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-797a8488-8247-4070-90bd-f636d8bd2b8d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:55.699790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-797a8488-8247-4070-90bd-f636d8bd2b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:55.732377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:55.735865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701358e-5b7b-429c-aba8-8d81638c7701 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:55.755247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:55.776877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d625d-0daf-444f-940a-04ace7e101d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:55.778323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d625d-0daf-444f-940a-04ace7e101d8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:55.778896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d625d-0daf-444f-940a-04ace7e101d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:55.779177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d625d-0daf-444f-940a-04ace7e101d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:55.780342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d625d-0daf-444f-940a-04ace7e101d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:55.781767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d625d-0daf-444f-940a-04ace7e101d8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:55.783590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 157/300] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:55.784502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d625d-0daf-444f-940a-04ace7e101d8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:55.793504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 144/301] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:55.794564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a8488-8247-4070-90bd-f636d8bd2b8d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:55.893427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d625d-0daf-444f-940a-04ace7e101d8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:55.913240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a8488-8247-4070-90bd-f636d8bd2b8d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:55.928401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220434ff-5eea-407b-87e2-8b3cc581b29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:55.929198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220434ff-5eea-407b-87e2-8b3cc581b29b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:55.929487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220434ff-5eea-407b-87e2-8b3cc581b29b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:55.929767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220434ff-5eea-407b-87e2-8b3cc581b29b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:55.940436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220434ff-5eea-407b-87e2-8b3cc581b29b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-220434ff-5eea-407b-87e2-8b3cc581b29b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:55.948236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:55.949784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:55.950639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 158/302] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:55.951315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220434ff-5eea-407b-87e2-8b3cc581b29b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:55.952604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4870-fde2-428b-92dc-70047ec47879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:55.953277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4870-fde2-428b-92dc-70047ec47879 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:55.953559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4870-fde2-428b-92dc-70047ec47879 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:55.953835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4870-fde2-428b-92dc-70047ec47879 None admin] PATH_INFO: `/v3/groups` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:55.955054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a4870-fde2-428b-92dc-70047ec47879 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:55.956574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a4870-fde2-428b-92dc-70047ec47879 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:55.973275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 145/303] 10.222.0.30 () {60 vars in 1134 bytes} [Mon May 23 17:53:55 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:53:55.976043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4870-fde2-428b-92dc-70047ec47879 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:56.007680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:56.027938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:56.076127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220434ff-5eea-407b-87e2-8b3cc581b29b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:56.128070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4237a-8435-40f0-a46b-ea192bd8e5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:56.129499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4237a-8435-40f0-a46b-ea192bd8e5fd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:56.130321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4237a-8435-40f0-a46b-ea192bd8e5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:56.130838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4237a-8435-40f0-a46b-ea192bd8e5fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:56.138658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4870-fde2-428b-92dc-70047ec47879 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:56.150087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4237a-8435-40f0-a46b-ea192bd8e5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-2fa4237a-8435-40f0-a46b-ea192bd8e5fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:56.160382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:56.161327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:56.162125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 159/304] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:56.168966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4237a-8435-40f0-a46b-ea192bd8e5fd None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:56.188666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc65a9-3d0d-449f-ba94-931676043a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:56.189351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc65a9-3d0d-449f-ba94-931676043a4d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:56.189637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc65a9-3d0d-449f-ba94-931676043a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:56.189915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc65a9-3d0d-449f-ba94-931676043a4d None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:56.190880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc65a9-3d0d-449f-ba94-931676043a4d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:56.191193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc65a9-3d0d-449f-ba94-931676043a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:56.193037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc65a9-3d0d-449f-ba94-931676043a4d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:56.202843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 146/305] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:56.209312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc65a9-3d0d-449f-ba94-931676043a4d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:56.296749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4237a-8435-40f0-a46b-ea192bd8e5fd None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:56.300066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:56.336548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc65a9-3d0d-449f-ba94-931676043a4d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:56.338373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:56.338871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5e5dd-1336-48ea-a340-db620003c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:56.341013 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5e5dd-1336-48ea-a340-db620003c1cd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:56.341303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5e5dd-1336-48ea-a340-db620003c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:56.341589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5e5dd-1336-48ea-a340-db620003c1cd None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:56.342346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5e5dd-1336-48ea-a340-db620003c1cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:56.342653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5e5dd-1336-48ea-a340-db620003c1cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:56.344384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5e5dd-1336-48ea-a340-db620003c1cd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:56.356094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 160/306] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:56.363256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5e5dd-1336-48ea-a340-db620003c1cd None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:56.381906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe553bf2-3a5d-4e6f-b286-af06e7b79fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:56.382918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe553bf2-3a5d-4e6f-b286-af06e7b79fac None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:56.383274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe553bf2-3a5d-4e6f-b286-af06e7b79fac None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:56.383641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe553bf2-3a5d-4e6f-b286-af06e7b79fac None admin] PATH_INFO: `/v3/users/bebc82cd17e04d99b7712624cf8ee201` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:56.398731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe553bf2-3a5d-4e6f-b286-af06e7b79fac None admin] RBAC: Authorizing `identity:get_user(user_id=bebc82cd17e04d99b7712624cf8ee201)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:56.401145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe553bf2-3a5d-4e6f-b286-af06e7b79fac None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:56.404187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 147/307] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:56 2022] GET /identity/v3/users/bebc82cd17e04d99b7712624cf8ee201 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:56.408117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564184e9-715f-4419-90e8-5849857e2ac6 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:56.408511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564184e9-715f-4419-90e8-5849857e2ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:56.408944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564184e9-715f-4419-90e8-5849857e2ac6 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:56.410575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 148/308] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:56.411516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564184e9-715f-4419-90e8-5849857e2ac6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:56.487831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5e5dd-1336-48ea-a340-db620003c1cd None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:56.527322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564184e9-715f-4419-90e8-5849857e2ac6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:56.527768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bd736-2842-4b11-81a4-3f8073255db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:56.528259 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bd736-2842-4b11-81a4-3f8073255db0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:56.528541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bd736-2842-4b11-81a4-3f8073255db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:56.528824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bd736-2842-4b11-81a4-3f8073255db0 None admin] PATH_INFO: `/v3/users/63d0a976b58e4406ba07fb9ed287f3e1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:56.530015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bd736-2842-4b11-81a4-3f8073255db0 None admin] RBAC: Authorizing `identity:get_user(user_id=63d0a976b58e4406ba07fb9ed287f3e1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:56.531499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bd736-2842-4b11-81a4-3f8073255db0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:56.533146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 161/309] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:56 2022] GET /identity/v3/users/63d0a976b58e4406ba07fb9ed287f3e1 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:56.533146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852816c-0ef6-454b-929c-20c7d144b789 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:56.533146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852816c-0ef6-454b-929c-20c7d144b789 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:56.533146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852816c-0ef6-454b-929c-20c7d144b789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:56.553629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c852816c-0ef6-454b-929c-20c7d144b789 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:56.554802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c852816c-0ef6-454b-929c-20c7d144b789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:56.568459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e49b1-7b70-40ca-8d4f-e3ccef8502a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:56.569110 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e49b1-7b70-40ca-8d4f-e3ccef8502a5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:56.569396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e49b1-7b70-40ca-8d4f-e3ccef8502a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:56.569674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e49b1-7b70-40ca-8d4f-e3ccef8502a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:56.570504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e49b1-7b70-40ca-8d4f-e3ccef8502a5 None admin] RBAC: Adding query filter params (role.id=ddd16047c21a4707886ce223206a83de, user.id=bebc82cd17e04d99b7712624cf8ee201, scope.system=all) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:56.570855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e49b1-7b70-40ca-8d4f-e3ccef8502a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:56.572288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e49b1-7b70-40ca-8d4f-e3ccef8502a5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:56.586740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 149/310] 10.222.0.30 () {56 vars in 1308 bytes} [Mon May 23 17:53:56 2022] GET /identity/v3/role_assignments?user.id=bebc82cd17e04d99b7712624cf8ee201&scope.system=all&role.id=ddd16047c21a4707886ce223206a83de => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:56.586740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e49b1-7b70-40ca-8d4f-e3ccef8502a5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:56.597266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:56.598366 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:56.646262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 162/311] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:56.672000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852816c-0ef6-454b-929c-20c7d144b789 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:56.701093 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e49b1-7b70-40ca-8d4f-e3ccef8502a5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:56.744582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43ac9a-05d5-454e-b129-6732dc7d0376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:56.745654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43ac9a-05d5-454e-b129-6732dc7d0376 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:56.747068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43ac9a-05d5-454e-b129-6732dc7d0376 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:56.747068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43ac9a-05d5-454e-b129-6732dc7d0376 None admin] PATH_INFO: `/v3/system/users/63d0a976b58e4406ba07fb9ed287f3e1/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:56.748560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43ac9a-05d5-454e-b129-6732dc7d0376 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=63d0a976b58e4406ba07fb9ed287f3e1, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:56.750242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43ac9a-05d5-454e-b129-6732dc7d0376 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:56.763971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 150/312] 10.222.0.30 () {58 vars in 1334 bytes} [Mon May 23 17:53:56 2022] PUT /identity/v3/system/users/63d0a976b58e4406ba07fb9ed287f3e1/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:53:56.790805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852816c-0ef6-454b-929c-20c7d144b789 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:56.831810 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac9397-d73a-4a71-b820-4057f01539b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:56.832546 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac9397-d73a-4a71-b820-4057f01539b2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:56.832821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac9397-d73a-4a71-b820-4057f01539b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:56.833095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac9397-d73a-4a71-b820-4057f01539b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:56.846827 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac9397-d73a-4a71-b820-4057f01539b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-9cac9397-d73a-4a71-b820-4057f01539b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:56.854904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:56.856073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:56.856888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 163/313] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:56.863047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43ac9a-05d5-454e-b129-6732dc7d0376 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:56.952333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:56.983529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43ac9a-05d5-454e-b129-6732dc7d0376 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:57.019699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ab44c-6578-4050-8ecc-b802bca375e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:57.020382 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ab44c-6578-4050-8ecc-b802bca375e0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:57.020668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ab44c-6578-4050-8ecc-b802bca375e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:57.020947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ab44c-6578-4050-8ecc-b802bca375e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:57.021699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ab44c-6578-4050-8ecc-b802bca375e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:57.022008 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ab44c-6578-4050-8ecc-b802bca375e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:57.023432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ab44c-6578-4050-8ecc-b802bca375e0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:57.033101 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 151/314] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:57.038579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac9397-d73a-4a71-b820-4057f01539b2 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:57.066686 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:57.147374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac9397-d73a-4a71-b820-4057f01539b2 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:57.181777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d704a-bb92-4bf6-b3ed-1fc87579c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:57.182653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d704a-bb92-4bf6-b3ed-1fc87579c3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:57.182955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d704a-bb92-4bf6-b3ed-1fc87579c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:57.183754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d704a-bb92-4bf6-b3ed-1fc87579c3d6 None admin] PATH_INFO: `/v3/users/a0ada9b94ff741b3b267d5ada4ac3192` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:57.184952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d704a-bb92-4bf6-b3ed-1fc87579c3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=a0ada9b94ff741b3b267d5ada4ac3192)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:57.186396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d704a-bb92-4bf6-b3ed-1fc87579c3d6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:57.188407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 164/315] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:57 2022] GET /identity/v3/users/a0ada9b94ff741b3b267d5ada4ac3192 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:57.193684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ab44c-6578-4050-8ecc-b802bca375e0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:57.305203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ab44c-6578-4050-8ecc-b802bca375e0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:57.340628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a6622-7f45-4a2a-b18b-3d1ff5b8f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:57.341291 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a6622-7f45-4a2a-b18b-3d1ff5b8f2eb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:57.341574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a6622-7f45-4a2a-b18b-3d1ff5b8f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:57.341855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a6622-7f45-4a2a-b18b-3d1ff5b8f2eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:57.345440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:57.415276 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a6622-7f45-4a2a-b18b-3d1ff5b8f2eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:57.416669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a6622-7f45-4a2a-b18b-3d1ff5b8f2eb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:57.526621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 152/316] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:53:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:53:57.535786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d704a-bb92-4bf6-b3ed-1fc87579c3d6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:57.631324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:57.642322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d704a-bb92-4bf6-b3ed-1fc87579c3d6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:57.678066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f8d0a-574c-403f-a301-b11fc2c10454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:57.678889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f8d0a-574c-403f-a301-b11fc2c10454 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:57.679226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f8d0a-574c-403f-a301-b11fc2c10454 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:57.679511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f8d0a-574c-403f-a301-b11fc2c10454 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:57.680704 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f8d0a-574c-403f-a301-b11fc2c10454 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:57.682180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f8d0a-574c-403f-a301-b11fc2c10454 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:57.684770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 165/317] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:53:57 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:57.690586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a6622-7f45-4a2a-b18b-3d1ff5b8f2eb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:57.727474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:57.805352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a6622-7f45-4a2a-b18b-3d1ff5b8f2eb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:57.843014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751ee90-968e-4cd2-9a65-98c4d4a254a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:57.843678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ee90-968e-4cd2-9a65-98c4d4a254a8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:57.843957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ee90-968e-4cd2-9a65-98c4d4a254a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:57.844230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ee90-968e-4cd2-9a65-98c4d4a254a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:57.845055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751ee90-968e-4cd2-9a65-98c4d4a254a8 None admin] RBAC: Adding query filter params (role.id=ddd16047c21a4707886ce223206a83de, scope.project.id=f89df535b56543e3b83b59bc617ffd14, user.id=a0ada9b94ff741b3b267d5ada4ac3192) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:57.845364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751ee90-968e-4cd2-9a65-98c4d4a254a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:57.847178 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751ee90-968e-4cd2-9a65-98c4d4a254a8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:57.853768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 153/318] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:53:57 2022] GET /identity/v3/role_assignments?user.id=a0ada9b94ff741b3b267d5ada4ac3192&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=ddd16047c21a4707886ce223206a83de => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:58.315878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713205ae-0fea-4bbc-8abe-99256f80a2e2 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:58.316254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713205ae-0fea-4bbc-8abe-99256f80a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:58.316446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713205ae-0fea-4bbc-8abe-99256f80a2e2 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:58.317800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 166/319] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:58.322871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501677a4-ad25-4472-94c0-8f987a74b697 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:58.323165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501677a4-ad25-4472-94c0-8f987a74b697 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:58.323443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501677a4-ad25-4472-94c0-8f987a74b697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:58.340711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-501677a4-ad25-4472-94c0-8f987a74b697 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:58.341892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-501677a4-ad25-4472-94c0-8f987a74b697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:58.410778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 154/320] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:58.432718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713205ae-0fea-4bbc-8abe-99256f80a2e2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:58.541807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713205ae-0fea-4bbc-8abe-99256f80a2e2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:58.576163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ac63d-ed21-48dd-95a8-2cde16185a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:58.576873 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ac63d-ed21-48dd-95a8-2cde16185a41 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:58.577155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ac63d-ed21-48dd-95a8-2cde16185a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:58.577428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ac63d-ed21-48dd-95a8-2cde16185a41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:58.578572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ac63d-ed21-48dd-95a8-2cde16185a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:58.580030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ac63d-ed21-48dd-95a8-2cde16185a41 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:58.581785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 167/321] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:53:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:58.587213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501677a4-ad25-4472-94c0-8f987a74b697 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:58.618021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:58.691084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501677a4-ad25-4472-94c0-8f987a74b697 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:58.734436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbc8ed-d812-418c-a11d-7091899b6f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:58.735147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbc8ed-d812-418c-a11d-7091899b6f5a None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:58.735433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbc8ed-d812-418c-a11d-7091899b6f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:58.735714 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbc8ed-d812-418c-a11d-7091899b6f5a None admin] PATH_INFO: `/v3/groups` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:58.736422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbc8ed-d812-418c-a11d-7091899b6f5a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:58.737869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbc8ed-d812-418c-a11d-7091899b6f5a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:58.760648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 155/322] 10.222.0.30 () {60 vars in 1134 bytes} [Mon May 23 17:53:58 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:53:58.901022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fb16-a7f6-4e7f-954c-3cc5c150f931 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:58.901380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fb16-a7f6-4e7f-954c-3cc5c150f931 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:58.901578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fb16-a7f6-4e7f-954c-3cc5c150f931 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:58.903861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 168/323] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:53:58.909328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f1364-b209-4cbc-b648-8d6f9200d3d8 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:58.909616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f1364-b209-4cbc-b648-8d6f9200d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:58.909900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f1364-b209-4cbc-b648-8d6f9200d3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:58.927405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9f1f1364-b209-4cbc-b648-8d6f9200d3d8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:58.928626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9f1f1364-b209-4cbc-b648-8d6f9200d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:59.002674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 156/324] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:59.026383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fb16-a7f6-4e7f-954c-3cc5c150f931 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:59.060599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:59.155755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fb16-a7f6-4e7f-954c-3cc5c150f931 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:59.192591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b7b3-79f4-40c2-bf65-d73ba05206fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:59.193386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b7b3-79f4-40c2-bf65-d73ba05206fd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:59.193658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b7b3-79f4-40c2-bf65-d73ba05206fd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:59.193929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b7b3-79f4-40c2-bf65-d73ba05206fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:59.206380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2b7b3-79f4-40c2-bf65-d73ba05206fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-98b2b7b3-79f4-40c2-bf65-d73ba05206fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:59.214276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:59.215774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:59.217192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 169/325] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:59.223035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f1364-b209-4cbc-b648-8d6f9200d3d8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:59.251390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fdbb3-f8a2-4c90-9650-d0ce6116ebcb None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:59.251720 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fdbb3-f8a2-4c90-9650-d0ce6116ebcb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:59.251942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fdbb3-f8a2-4c90-9650-d0ce6116ebcb None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:59.253529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:59.253651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 170/326] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:53:59.260055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb129-315b-4aa5-be8d-b81adb95eca6 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:59.260337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb129-315b-4aa5-be8d-b81adb95eca6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:59.260614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb129-315b-4aa5-be8d-b81adb95eca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:59.284152 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6d4eb129-315b-4aa5-be8d-b81adb95eca6 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:53:59.285390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6d4eb129-315b-4aa5-be8d-b81adb95eca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:53:59.356541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f1364-b209-4cbc-b648-8d6f9200d3d8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:59.365077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 171/327] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:53:59.394008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eb129-315b-4aa5-be8d-b81adb95eca6 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:59.401751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cce53-877c-43a8-9539-01a061ecf3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:59.402978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cce53-877c-43a8-9539-01a061ecf3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:59.403269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cce53-877c-43a8-9539-01a061ecf3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:59.403537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cce53-877c-43a8-9539-01a061ecf3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:59.404901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cce53-877c-43a8-9539-01a061ecf3b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:59.405213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cce53-877c-43a8-9539-01a061ecf3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:59.407168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cce53-877c-43a8-9539-01a061ecf3b2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:59.416357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:59.419695 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 157/328] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:59.425173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cce53-877c-43a8-9539-01a061ecf3b2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:59.515235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eb129-315b-4aa5-be8d-b81adb95eca6 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:59.518860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:59.541790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cce53-877c-43a8-9539-01a061ecf3b2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:59.562578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597ddf1-5573-4d70-b03e-6333364723b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:59.563346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597ddf1-5573-4d70-b03e-6333364723b5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:59.563630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597ddf1-5573-4d70-b03e-6333364723b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:59.563908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597ddf1-5573-4d70-b03e-6333364723b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:59.577172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597ddf1-5573-4d70-b03e-6333364723b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-9597ddf1-5573-4d70-b03e-6333364723b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:53:59.585118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:53:59.586019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:53:59.591332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 172/329] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:53:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:53:59.593593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3a33f-424d-4657-ab0b-825738d8cd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:59.594500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3a33f-424d-4657-ab0b-825738d8cd05 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:59.594817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3a33f-424d-4657-ab0b-825738d8cd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:59.595145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3a33f-424d-4657-ab0b-825738d8cd05 None admin] PATH_INFO: `/v3/users/bebc82cd17e04d99b7712624cf8ee201` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:59.595654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597ddf1-5573-4d70-b03e-6333364723b5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:59.596503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3a33f-424d-4657-ab0b-825738d8cd05 None admin] RBAC: Authorizing `identity:get_user(user_id=bebc82cd17e04d99b7712624cf8ee201)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:59.597960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3a33f-424d-4657-ab0b-825738d8cd05 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:59.600993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 158/330] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:59 2022] GET /identity/v3/users/bebc82cd17e04d99b7712624cf8ee201 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:53:59.607153 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3a33f-424d-4657-ab0b-825738d8cd05 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:59.691377 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:59.719275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3a33f-424d-4657-ab0b-825738d8cd05 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:59.720234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597ddf1-5573-4d70-b03e-6333364723b5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:59.754916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e7ca6-34be-4745-9586-d832aab1b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:59.755806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e7ca6-34be-4745-9586-d832aab1b7b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:59.756094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e7ca6-34be-4745-9586-d832aab1b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:59.756372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e7ca6-34be-4745-9586-d832aab1b7b2 None admin] PATH_INFO: `/v3/system/users/bebc82cd17e04d99b7712624cf8ee201/roles/ddd16047c21a4707886ce223206a83de` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:59.757919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e7ca6-34be-4745-9586-d832aab1b7b2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bebc82cd17e04d99b7712624cf8ee201, role_id=ddd16047c21a4707886ce223206a83de)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:59.759295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8f3da-396e-491f-b258-039bcb0866b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:59.759615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e7ca6-34be-4745-9586-d832aab1b7b2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:59.760401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8f3da-396e-491f-b258-039bcb0866b5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:59.760915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8f3da-396e-491f-b258-039bcb0866b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:59.761998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8f3da-396e-491f-b258-039bcb0866b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:59.763163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8f3da-396e-491f-b258-039bcb0866b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:53:59.763909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8f3da-396e-491f-b258-039bcb0866b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:59.765573 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8f3da-396e-491f-b258-039bcb0866b5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:59.773402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 159/331] 10.222.0.30 () {58 vars in 1334 bytes} [Mon May 23 17:53:59 2022] PUT /identity/v3/system/users/bebc82cd17e04d99b7712624cf8ee201/roles/ddd16047c21a4707886ce223206a83de => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:53:59.778851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 173/332] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:53:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:59.783030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e7ca6-34be-4745-9586-d832aab1b7b2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:53:59.804780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:53:59.906002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e7ca6-34be-4745-9586-d832aab1b7b2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:53:59.947345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b5e2d-02b5-447d-b08e-585722b76f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:53:59.948725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b5e2d-02b5-447d-b08e-585722b76f09 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:53:59.949212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b5e2d-02b5-447d-b08e-585722b76f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:53:59.949875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b5e2d-02b5-447d-b08e-585722b76f09 None admin] PATH_INFO: `/v3/users/63d0a976b58e4406ba07fb9ed287f3e1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:53:59.951468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b5e2d-02b5-447d-b08e-585722b76f09 None admin] RBAC: Authorizing `identity:get_user(user_id=63d0a976b58e4406ba07fb9ed287f3e1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:53:59.953164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b5e2d-02b5-447d-b08e-585722b76f09 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:53:59.958807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 160/333] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:53:59 2022] GET /identity/v3/users/63d0a976b58e4406ba07fb9ed287f3e1 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:53:59.961754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8f3da-396e-491f-b258-039bcb0866b5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:00.074877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8f3da-396e-491f-b258-039bcb0866b5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:00.111649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1baff-dcd6-4ed9-a014-55cc875b8546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:00.112667 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1baff-dcd6-4ed9-a014-55cc875b8546 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:00.113159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1baff-dcd6-4ed9-a014-55cc875b8546 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:00.113633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1baff-dcd6-4ed9-a014-55cc875b8546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:00.114648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1baff-dcd6-4ed9-a014-55cc875b8546 None admin] RBAC: Adding query filter params (role.id=bce93d0b549349079c3292eb120d54c1, user.id=63d0a976b58e4406ba07fb9ed287f3e1, scope.system=all) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:00.115273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1baff-dcd6-4ed9-a014-55cc875b8546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:00.116886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1baff-dcd6-4ed9-a014-55cc875b8546 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:00.124598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:00.134456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 174/334] 10.222.0.30 () {56 vars in 1308 bytes} [Mon May 23 17:53:59 2022] GET /identity/v3/role_assignments?user.id=63d0a976b58e4406ba07fb9ed287f3e1&scope.system=all&role.id=bce93d0b549349079c3292eb120d54c1 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:01.478563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4210d-7056-420f-ab97-cbc27d6ebf5d None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:01.479621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4210d-7056-420f-ab97-cbc27d6ebf5d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:01.480200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4210d-7056-420f-ab97-cbc27d6ebf5d None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:01.482133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 161/335] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:01.488233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7337a-e630-4000-ab86-75a495444ae8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:01.489110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7337a-e630-4000-ab86-75a495444ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:01.489609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7337a-e630-4000-ab86-75a495444ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:01.517020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-42d7337a-e630-4000-ab86-75a495444ae8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:01.519044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-42d7337a-e630-4000-ab86-75a495444ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:01.629299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 175/336] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:01.669557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4210d-7056-420f-ab97-cbc27d6ebf5d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:01.773768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:01.795705 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4210d-7056-420f-ab97-cbc27d6ebf5d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:01.840682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f39be-fae9-48c6-8783-330011b6b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:01.841486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f39be-fae9-48c6-8783-330011b6b873 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:01.841772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f39be-fae9-48c6-8783-330011b6b873 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:01.842051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f39be-fae9-48c6-8783-330011b6b873 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:01.856299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f39be-fae9-48c6-8783-330011b6b873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-391f39be-fae9-48c6-8783-330011b6b873 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:01.864137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:01.865044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:01.865836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 162/337] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:01.871569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7337a-e630-4000-ab86-75a495444ae8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:01.904917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895627b0-f621-44ca-96c5-d16be37b0278 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:01.905232 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895627b0-f621-44ca-96c5-d16be37b0278 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:01.905471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895627b0-f621-44ca-96c5-d16be37b0278 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:01.906879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 163/338] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:54:01.923214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91b82-c7e1-45fe-ba6a-c8c840fb364a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:01.923504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91b82-c7e1-45fe-ba6a-c8c840fb364a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:01.923767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91b82-c7e1-45fe-ba6a-c8c840fb364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:01.948224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-33f91b82-c7e1-45fe-ba6a-c8c840fb364a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:01.950094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-33f91b82-c7e1-45fe-ba6a-c8c840fb364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:02.052601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7337a-e630-4000-ab86-75a495444ae8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:02.093672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 164/339] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 23 17:54:02.104335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:02.112797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ebeef-0ad7-4fa6-b864-eda91de6b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:02.113720 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ebeef-0ad7-4fa6-b864-eda91de6b7ff None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:02.114169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ebeef-0ad7-4fa6-b864-eda91de6b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:02.114594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ebeef-0ad7-4fa6-b864-eda91de6b7ff None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:02.119527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ebeef-0ad7-4fa6-b864-eda91de6b7ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:02.119993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ebeef-0ad7-4fa6-b864-eda91de6b7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:02.122088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ebeef-0ad7-4fa6-b864-eda91de6b7ff None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:02.132018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 176/340] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:54:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:02.138676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f91b82-c7e1-45fe-ba6a-c8c840fb364a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:02.152430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ebeef-0ad7-4fa6-b864-eda91de6b7ff None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:02.278734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:02.338030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ebeef-0ad7-4fa6-b864-eda91de6b7ff None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:02.340925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f91b82-c7e1-45fe-ba6a-c8c840fb364a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:02.380952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac695bfc-24b6-4815-b3ba-81c850ddd2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:02.382074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac695bfc-24b6-4815-b3ba-81c850ddd2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:02.382526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac695bfc-24b6-4815-b3ba-81c850ddd2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:02.382991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac695bfc-24b6-4815-b3ba-81c850ddd2c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:02.394093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac695bfc-24b6-4815-b3ba-81c850ddd2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-ac695bfc-24b6-4815-b3ba-81c850ddd2c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:02.405224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:02.406136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:02.406953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:02.412825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 177/341] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:54:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:02.415606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac695bfc-24b6-4815-b3ba-81c850ddd2c5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:02.448293 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d8208-f0ee-4d78-80d6-db7b3e1d29dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:02.449296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d8208-f0ee-4d78-80d6-db7b3e1d29dc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:02.449737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d8208-f0ee-4d78-80d6-db7b3e1d29dc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:02.450167 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d8208-f0ee-4d78-80d6-db7b3e1d29dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:02.479303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:02.558076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac695bfc-24b6-4815-b3ba-81c850ddd2c5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:02.613636 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864ed05-e0ac-4853-b625-0147c1e23291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:02.614633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864ed05-e0ac-4853-b625-0147c1e23291 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:02.615111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864ed05-e0ac-4853-b625-0147c1e23291 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:02.616092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864ed05-e0ac-4853-b625-0147c1e23291 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:02.617332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864ed05-e0ac-4853-b625-0147c1e23291 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:02.617812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864ed05-e0ac-4853-b625-0147c1e23291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:02.619687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864ed05-e0ac-4853-b625-0147c1e23291 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:02.637911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 178/342] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:02.644054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864ed05-e0ac-4853-b625-0147c1e23291 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:02.645931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d8208-f0ee-4d78-80d6-db7b3e1d29dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:02.647493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d8208-f0ee-4d78-80d6-db7b3e1d29dc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:02.747786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:02.795071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 165/343] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:02.796031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d8208-f0ee-4d78-80d6-db7b3e1d29dc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:02.828612 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864ed05-e0ac-4853-b625-0147c1e23291 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:02.851471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:02.896645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4f625-37d2-4878-a1c1-a6e539749933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:02.897697 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4f625-37d2-4878-a1c1-a6e539749933 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:02.898250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4f625-37d2-4878-a1c1-a6e539749933 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:02.898714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4f625-37d2-4878-a1c1-a6e539749933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:02.946639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d8208-f0ee-4d78-80d6-db7b3e1d29dc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:02.992554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d9b9a-c015-4340-8c08-d96db8b8613a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:02.993377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d9b9a-c015-4340-8c08-d96db8b8613a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:02.993663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d9b9a-c015-4340-8c08-d96db8b8613a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:02.993949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d9b9a-c015-4340-8c08-d96db8b8613a None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:02.996834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d9b9a-c015-4340-8c08-d96db8b8613a None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:02.998330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d9b9a-c015-4340-8c08-d96db8b8613a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:03.000407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 166/344] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:02 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:03.006057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d9b9a-c015-4340-8c08-d96db8b8613a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:03.012801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4f625-37d2-4878-a1c1-a6e539749933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:03.014534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4f625-37d2-4878-a1c1-a6e539749933 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:03.092324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:03.189408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 179/345] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:03.190946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4f625-37d2-4878-a1c1-a6e539749933 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:03.211042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:03.262741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d9b9a-c015-4340-8c08-d96db8b8613a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:03.344240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8181e2-26c0-4603-8171-6b2b0dc52f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:03.345111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8181e2-26c0-4603-8171-6b2b0dc52f24 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.345411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8181e2-26c0-4603-8171-6b2b0dc52f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.345670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8181e2-26c0-4603-8171-6b2b0dc52f24 None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.353070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8181e2-26c0-4603-8171-6b2b0dc52f24 None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:03.354711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8181e2-26c0-4603-8171-6b2b0dc52f24 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:03.358328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 167/346] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:03 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:03.359618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb58ab-2677-40b0-b34a-96387577fe5b None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.359903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb58ab-2677-40b0-b34a-96387577fe5b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.360177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb58ab-2677-40b0-b34a-96387577fe5b None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.361446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 168/347] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:03.364141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb58ab-2677-40b0-b34a-96387577fe5b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:03.372124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4f625-37d2-4878-a1c1-a6e539749933 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:03.440378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aee2f-bedc-4cad-939b-f214903a680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:03.441163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aee2f-bedc-4cad-939b-f214903a680d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.441446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aee2f-bedc-4cad-939b-f214903a680d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.441725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aee2f-bedc-4cad-939b-f214903a680d None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.444070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aee2f-bedc-4cad-939b-f214903a680d None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:03.445525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aee2f-bedc-4cad-939b-f214903a680d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:03.448455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 180/348] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:03 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:03.450170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbf15b-545e-4102-842f-c0521034957e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.450456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbf15b-545e-4102-842f-c0521034957e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.450757 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbf15b-545e-4102-842f-c0521034957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.476378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-86dbf15b-545e-4102-842f-c0521034957e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:03.477722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-86dbf15b-545e-4102-842f-c0521034957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:03.547655 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb58ab-2677-40b0-b34a-96387577fe5b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:03.550572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:03.568563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 181/349] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:03.569960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbf15b-545e-4102-842f-c0521034957e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:03.581840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:03.595250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b558c81-5cb3-4190-8292-8f721242605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:03.596267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b558c81-5cb3-4190-8292-8f721242605e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.596897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b558c81-5cb3-4190-8292-8f721242605e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.597482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b558c81-5cb3-4190-8292-8f721242605e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.598520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b558c81-5cb3-4190-8292-8f721242605e None admin] RBAC: Adding query filter params (group.id=2acb4a44d6094655b2f6d635738bc3e4, role.id=bce93d0b549349079c3292eb120d54c1, scope.project.id=784d0612b566498b8205942e82777be5) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:03.599060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b558c81-5cb3-4190-8292-8f721242605e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:03.600920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b558c81-5cb3-4190-8292-8f721242605e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:03.609792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 169/350] 10.222.0.30 () {56 vars in 1376 bytes} [Mon May 23 17:54:03 2022] GET /identity/v3/role_assignments?group.id=2acb4a44d6094655b2f6d635738bc3e4&scope.project.id=784d0612b566498b8205942e82777be5&role.id=bce93d0b549349079c3292eb120d54c1 => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:03.611866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7134c4-5161-4c1c-86a1-2b08afe86d9e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.612467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7134c4-5161-4c1c-86a1-2b08afe86d9e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.612962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7134c4-5161-4c1c-86a1-2b08afe86d9e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.618778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 170/351] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:03.620062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7134c4-5161-4c1c-86a1-2b08afe86d9e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:03.742046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbf15b-545e-4102-842f-c0521034957e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:03.789895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdeaba-c26c-40d8-9754-4bc22349bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:03.791215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdeaba-c26c-40d8-9754-4bc22349bcad None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.791750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdeaba-c26c-40d8-9754-4bc22349bcad None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.793696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdeaba-c26c-40d8-9754-4bc22349bcad None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.795288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdeaba-c26c-40d8-9754-4bc22349bcad None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:03.797579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdeaba-c26c-40d8-9754-4bc22349bcad None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:03.800404 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 182/352] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:03 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:03.804486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576390b-8592-4710-8ec8-a08020ecd9b3 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.804486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576390b-8592-4710-8ec8-a08020ecd9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.804699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576390b-8592-4710-8ec8-a08020ecd9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.831780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f576390b-8592-4710-8ec8-a08020ecd9b3 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:03.833011 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f576390b-8592-4710-8ec8-a08020ecd9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:03.841471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7134c4-5161-4c1c-86a1-2b08afe86d9e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:03.889342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f97663-dc2b-4909-ab7d-18f4acf26eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:03.890155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f97663-dc2b-4909-ab7d-18f4acf26eae None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.890438 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f97663-dc2b-4909-ab7d-18f4acf26eae None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.890731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f97663-dc2b-4909-ab7d-18f4acf26eae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.906300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f97663-dc2b-4909-ab7d-18f4acf26eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c7f97663-dc2b-4909-ab7d-18f4acf26eae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:03.914334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:03.915285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:03.916097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:03.920309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 171/353] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:03.920309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74b493-0827-4e8f-9500-93f927621cc8 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.920309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74b493-0827-4e8f-9500-93f927621cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.920309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74b493-0827-4e8f-9500-93f927621cc8 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.920721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 172/354] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:03.921114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74b493-0827-4e8f-9500-93f927621cc8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:03.931409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 183/355] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:03.932293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee403459-5335-40b5-956f-4478fd38b9e6 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:03.932583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee403459-5335-40b5-956f-4478fd38b9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:03.932890 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee403459-5335-40b5-956f-4478fd38b9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:03.971010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:03.980919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ee403459-5335-40b5-956f-4478fd38b9e6 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:03.982103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ee403459-5335-40b5-956f-4478fd38b9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:03.984393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:04.060431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 184/356] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:04.062167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee403459-5335-40b5-956f-4478fd38b9e6 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:04.062732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74b493-0827-4e8f-9500-93f927621cc8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:04.109372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8ff97-f984-4c03-83bb-4663a98e2a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:04.110476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8ff97-f984-4c03-83bb-4663a98e2a1b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:04.111020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8ff97-f984-4c03-83bb-4663a98e2a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:04.111530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8ff97-f984-4c03-83bb-4663a98e2a1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:04.113278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8ff97-f984-4c03-83bb-4663a98e2a1b None admin] RBAC: Adding query filter params (group.id=2acb4a44d6094655b2f6d635738bc3e4, role.id=66b09c60197a4a1fb2cca5402bb83375, scope.project.id=784d0612b566498b8205942e82777be5) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:04.113838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8ff97-f984-4c03-83bb-4663a98e2a1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:04.116448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8ff97-f984-4c03-83bb-4663a98e2a1b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:04.125161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 173/357] 10.222.0.30 () {56 vars in 1376 bytes} [Mon May 23 17:54:03 2022] GET /identity/v3/role_assignments?group.id=2acb4a44d6094655b2f6d635738bc3e4&scope.project.id=784d0612b566498b8205942e82777be5&role.id=66b09c60197a4a1fb2cca5402bb83375 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:04.126389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8ff97-f984-4c03-83bb-4663a98e2a1b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:04.240198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:04.262556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8ff97-f984-4c03-83bb-4663a98e2a1b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:04.264562 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee403459-5335-40b5-956f-4478fd38b9e6 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:04.336147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfb869-46ce-4504-9801-ccd02098f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:04.336725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfb869-46ce-4504-9801-ccd02098f844 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:04.337005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfb869-46ce-4504-9801-ccd02098f844 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:04.337276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfb869-46ce-4504-9801-ccd02098f844 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:04.338034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfb869-46ce-4504-9801-ccd02098f844 None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:04.338337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfb869-46ce-4504-9801-ccd02098f844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:04.340800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfb869-46ce-4504-9801-ccd02098f844 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:04.344032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bc216-402e-4182-b52e-602e9574a754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:04.345530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bc216-402e-4182-b52e-602e9574a754 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:04.346747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bc216-402e-4182-b52e-602e9574a754 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:04.347071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bc216-402e-4182-b52e-602e9574a754 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:04.358519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:04.360577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bc216-402e-4182-b52e-602e9574a754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:04.368331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 185/358] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:54:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:04.369758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfb869-46ce-4504-9801-ccd02098f844 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-7e5bc216-402e-4182-b52e-602e9574a754 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:04.370250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:04.371757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:04.372546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 174/359] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:54:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:04.374189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5f70-4636-4df1-a6e7-26c4c341f50a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:04.374293 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5f70-4636-4df1-a6e7-26c4c341f50a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:04.374859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5f70-4636-4df1-a6e7-26c4c341f50a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:04.377051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 175/360] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:04.377796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd5f70-4636-4df1-a6e7-26c4c341f50a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:04.529312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd5f70-4636-4df1-a6e7-26c4c341f50a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:04.532069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfb869-46ce-4504-9801-ccd02098f844 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:04.584972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6e23c-bcd3-4e64-b21d-8ae98385036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:04.585722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54dac-e488-425b-a79e-d59fc7b2fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:04.586765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54dac-e488-425b-a79e-d59fc7b2fca3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:04.587000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54dac-e488-425b-a79e-d59fc7b2fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:04.587279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54dac-e488-425b-a79e-d59fc7b2fca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:04.587503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e23c-bcd3-4e64-b21d-8ae98385036c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:04.587971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e23c-bcd3-4e64-b21d-8ae98385036c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:04.588435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e23c-bcd3-4e64-b21d-8ae98385036c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:04.603984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6e23c-bcd3-4e64-b21d-8ae98385036c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-78a6e23c-bcd3-4e64-b21d-8ae98385036c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:04.613148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:04.614104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 17:54:04.615391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:04.616006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:04.617608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 186/361] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:04.618630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6e23c-bcd3-4e64-b21d-8ae98385036c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:04.682024 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d54dac-e488-425b-a79e-d59fc7b2fca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:04.684541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d54dac-e488-425b-a79e-d59fc7b2fca3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:04.705147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:04.769618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6e23c-bcd3-4e64-b21d-8ae98385036c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:04.814949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b8d90-a88d-4b39-86a3-27b8ae5b93ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:04.815983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b8d90-a88d-4b39-86a3-27b8ae5b93ec None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:04.816491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b8d90-a88d-4b39-86a3-27b8ae5b93ec None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:04.816962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b8d90-a88d-4b39-86a3-27b8ae5b93ec None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:04.817901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b8d90-a88d-4b39-86a3-27b8ae5b93ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:04.818408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b8d90-a88d-4b39-86a3-27b8ae5b93ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:04.820609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 176/362] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:04.821527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b8d90-a88d-4b39-86a3-27b8ae5b93ec None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:04.826933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde52b9-d480-4064-9e4b-5c7f20a3330a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:04.826933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde52b9-d480-4064-9e4b-5c7f20a3330a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:04.826933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde52b9-d480-4064-9e4b-5c7f20a3330a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:04.836555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 187/363] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:04.837703 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b8d90-a88d-4b39-86a3-27b8ae5b93ec None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:04.846441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2fde52b9-d480-4064-9e4b-5c7f20a3330a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:04.847659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2fde52b9-d480-4064-9e4b-5c7f20a3330a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:04.913351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:04.943057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 177/364] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:04.944005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde52b9-d480-4064-9e4b-5c7f20a3330a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:04.976760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b8d90-a88d-4b39-86a3-27b8ae5b93ec None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:05.002557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:05.017138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227319eb-2285-41a3-ba91-d085fd3e7ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:05.017831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227319eb-2285-41a3-ba91-d085fd3e7ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:05.018090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227319eb-2285-41a3-ba91-d085fd3e7ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:05.018369 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227319eb-2285-41a3-ba91-d085fd3e7ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:05.019163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227319eb-2285-41a3-ba91-d085fd3e7ab6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:05.019468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227319eb-2285-41a3-ba91-d085fd3e7ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:05.020842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227319eb-2285-41a3-ba91-d085fd3e7ab6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:05.030145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 188/365] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:54:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:05.031161 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227319eb-2285-41a3-ba91-d085fd3e7ab6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:05.078409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde52b9-d480-4064-9e4b-5c7f20a3330a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:05.117183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51a7f-28f2-44fd-b2ce-21a0b9551e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:05.118446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51a7f-28f2-44fd-b2ce-21a0b9551e77 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:05.119058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51a7f-28f2-44fd-b2ce-21a0b9551e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:05.119583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51a7f-28f2-44fd-b2ce-21a0b9551e77 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:05.121603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c51a7f-28f2-44fd-b2ce-21a0b9551e77 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:05.123397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c51a7f-28f2-44fd-b2ce-21a0b9551e77 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:05.125724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 178/366] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:04 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:05.131078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51a7f-28f2-44fd-b2ce-21a0b9551e77 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:05.142185 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227319eb-2285-41a3-ba91-d085fd3e7ab6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:05.179406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9248f4-566a-4f40-9d47-431876832d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:05.179960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9248f4-566a-4f40-9d47-431876832d92 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:05.180244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9248f4-566a-4f40-9d47-431876832d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:05.180518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9248f4-566a-4f40-9d47-431876832d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:05.190807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:05.237733 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:05.250748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51a7f-28f2-44fd-b2ce-21a0b9551e77 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:05.255046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9248f4-566a-4f40-9d47-431876832d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:05.256535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9248f4-566a-4f40-9d47-431876832d92 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:05.289584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a02f6f-281f-4f08-9f2d-dfbf66f54d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:05.291905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02f6f-281f-4f08-9f2d-dfbf66f54d8d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:05.292455 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02f6f-281f-4f08-9f2d-dfbf66f54d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:05.293015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02f6f-281f-4f08-9f2d-dfbf66f54d8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:05.304457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a02f6f-281f-4f08-9f2d-dfbf66f54d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-47a02f6f-281f-4f08-9f2d-dfbf66f54d8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:05.313619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:05.314510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:05.315349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:05.318103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 179/367] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:05.323412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a02f6f-281f-4f08-9f2d-dfbf66f54d8d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:05.364419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 189/368] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:05.364820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9248f4-566a-4f40-9d47-431876832d92 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:05.437207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a02f6f-281f-4f08-9f2d-dfbf66f54d8d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:05.448946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:05.456194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:05.474345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9248f4-566a-4f40-9d47-431876832d92 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:05.481199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e25e-6df4-4402-a835-640dea400f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:05.482508 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e25e-6df4-4402-a835-640dea400f4f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:05.483070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e25e-6df4-4402-a835-640dea400f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:05.483545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e25e-6df4-4402-a835-640dea400f4f None admin] PATH_INFO: `/v3/users/bebc82cd17e04d99b7712624cf8ee201` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:05.485081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07e25e-6df4-4402-a835-640dea400f4f None admin] RBAC: Authorizing `identity:get_user(user_id=bebc82cd17e04d99b7712624cf8ee201)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:05.488104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07e25e-6df4-4402-a835-640dea400f4f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:05.489978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 180/369] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:54:05 2022] GET /identity/v3/users/bebc82cd17e04d99b7712624cf8ee201 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:05.491141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e25e-6df4-4402-a835-640dea400f4f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:05.517190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4ec53-0698-49fa-b9f4-7632f4312d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:05.522842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4ec53-0698-49fa-b9f4-7632f4312d82 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:05.523118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4ec53-0698-49fa-b9f4-7632f4312d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:05.523397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4ec53-0698-49fa-b9f4-7632f4312d82 None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:05.524679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4ec53-0698-49fa-b9f4-7632f4312d82 None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:05.526142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4ec53-0698-49fa-b9f4-7632f4312d82 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:05.528476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 190/370] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:05 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:05.528476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4ec53-0698-49fa-b9f4-7632f4312d82 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:05.625912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e25e-6df4-4402-a835-640dea400f4f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:05.646552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4ec53-0698-49fa-b9f4-7632f4312d82 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:05.665446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e9fbd-bd11-4e54-b6ab-99e093ec218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:05.666452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e9fbd-bd11-4e54-b6ab-99e093ec218e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:05.666962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e9fbd-bd11-4e54-b6ab-99e093ec218e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:05.668348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e9fbd-bd11-4e54-b6ab-99e093ec218e None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:05.670013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e9fbd-bd11-4e54-b6ab-99e093ec218e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:05.670896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e9fbd-bd11-4e54-b6ab-99e093ec218e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:05.673680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e9fbd-bd11-4e54-b6ab-99e093ec218e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:05.683237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5120-8208-4f92-a4a3-2638bf37a03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:05.684306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5120-8208-4f92-a4a3-2638bf37a03b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:05.684591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5120-8208-4f92-a4a3-2638bf37a03b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:05.684868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5120-8208-4f92-a4a3-2638bf37a03b None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:05.686118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa5120-8208-4f92-a4a3-2638bf37a03b None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:05.687649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 181/371] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:05.687777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa5120-8208-4f92-a4a3-2638bf37a03b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:05.688892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e9fbd-bd11-4e54-b6ab-99e093ec218e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:05.693731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 191/372] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:05 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:05.693731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5120-8208-4f92-a4a3-2638bf37a03b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:05.727818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:05.749892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:05.831686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e9fbd-bd11-4e54-b6ab-99e093ec218e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:05.834302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5120-8208-4f92-a4a3-2638bf37a03b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:05.872792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1799bc-d6c7-43d9-983b-aad8543ba04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:05.873682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1799bc-d6c7-43d9-983b-aad8543ba04f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:05.874110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1799bc-d6c7-43d9-983b-aad8543ba04f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:05.874587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1799bc-d6c7-43d9-983b-aad8543ba04f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:05.876006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0514a9-e96e-4316-b8de-d019d2dc9d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:05.876444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0514a9-e96e-4316-b8de-d019d2dc9d2e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:05.876517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0514a9-e96e-4316-b8de-d019d2dc9d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:05.876702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1799bc-d6c7-43d9-983b-aad8543ba04f None admin] RBAC: Adding query filter params (group.id=2acb4a44d6094655b2f6d635738bc3e4, role.id=bce93d0b549349079c3292eb120d54c1, scope.project.id=f89df535b56543e3b83b59bc617ffd14) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:05.876814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0514a9-e96e-4316-b8de-d019d2dc9d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:05.877285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1799bc-d6c7-43d9-983b-aad8543ba04f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:05.877600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0514a9-e96e-4316-b8de-d019d2dc9d2e None admin] RBAC: Adding query filter params (role.id=ddd16047c21a4707886ce223206a83de, user.id=bebc82cd17e04d99b7712624cf8ee201, scope.system=all) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:05.877901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0514a9-e96e-4316-b8de-d019d2dc9d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:05.879328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1799bc-d6c7-43d9-983b-aad8543ba04f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:05.879458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0514a9-e96e-4316-b8de-d019d2dc9d2e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:05.886861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 192/373] 10.222.0.30 () {56 vars in 1376 bytes} [Mon May 23 17:54:05 2022] GET /identity/v3/role_assignments?group.id=2acb4a44d6094655b2f6d635738bc3e4&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=bce93d0b549349079c3292eb120d54c1 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:05.888008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1799bc-d6c7-43d9-983b-aad8543ba04f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:05.894846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 182/374] 10.222.0.30 () {56 vars in 1308 bytes} [Mon May 23 17:54:05 2022] GET /identity/v3/role_assignments?user.id=bebc82cd17e04d99b7712624cf8ee201&scope.system=all&role.id=ddd16047c21a4707886ce223206a83de => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:05.895751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0514a9-e96e-4316-b8de-d019d2dc9d2e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:06.029711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:06.033893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0514a9-e96e-4316-b8de-d019d2dc9d2e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:06.078794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd5383-27b3-4974-9cee-da27ebf69e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:06.079456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd5383-27b3-4974-9cee-da27ebf69e02 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.079737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd5383-27b3-4974-9cee-da27ebf69e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.080010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd5383-27b3-4974-9cee-da27ebf69e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:06.102362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:06.124862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1799bc-d6c7-43d9-983b-aad8543ba04f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:06.173491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ea116-48c7-4cbc-b874-c84398b406d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:06.174891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea116-48c7-4cbc-b874-c84398b406d2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.175413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea116-48c7-4cbc-b874-c84398b406d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.175893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea116-48c7-4cbc-b874-c84398b406d2 None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:06.177449 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ea116-48c7-4cbc-b874-c84398b406d2 None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:06.178530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd5383-27b3-4974-9cee-da27ebf69e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:06.179487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ea116-48c7-4cbc-b874-c84398b406d2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:06.180053 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd5383-27b3-4974-9cee-da27ebf69e02 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:06.182062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 193/375] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:05 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:06.195947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ea116-48c7-4cbc-b874-c84398b406d2 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:06.310535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:06.315298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 183/376] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:06.321160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd5383-27b3-4974-9cee-da27ebf69e02 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:06.392559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ea116-48c7-4cbc-b874-c84398b406d2 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:06.440848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd5383-27b3-4974-9cee-da27ebf69e02 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:06.470207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4c32a-7f7b-4dc6-8b41-da05757f5b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:06.471146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c32a-7f7b-4dc6-8b41-da05757f5b0c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.471604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c32a-7f7b-4dc6-8b41-da05757f5b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.472078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c32a-7f7b-4dc6-8b41-da05757f5b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:06.473169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4c32a-7f7b-4dc6-8b41-da05757f5b0c None admin] RBAC: Adding query filter params (group.id=2acb4a44d6094655b2f6d635738bc3e4, role.id=66b09c60197a4a1fb2cca5402bb83375, scope.project.id=f89df535b56543e3b83b59bc617ffd14) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:06.473626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4c32a-7f7b-4dc6-8b41-da05757f5b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:06.475418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4c32a-7f7b-4dc6-8b41-da05757f5b0c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:06.481468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a1aee-1072-4792-8487-6eedaeb1babe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:06.482470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a1aee-1072-4792-8487-6eedaeb1babe None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.482893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a1aee-1072-4792-8487-6eedaeb1babe None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.486732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a1aee-1072-4792-8487-6eedaeb1babe None admin] PATH_INFO: `/v3/projects/883a3e766acb4bf0a201fc243774389f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:06.486732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a1aee-1072-4792-8487-6eedaeb1babe None admin] RBAC: Authorizing `identity:get_project(project_id=883a3e766acb4bf0a201fc243774389f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:06.486732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a1aee-1072-4792-8487-6eedaeb1babe None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:06.488956 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 184/377] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:06 2022] GET /identity/v3/projects/883a3e766acb4bf0a201fc243774389f => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:06.490328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 194/378] 10.222.0.30 () {56 vars in 1376 bytes} [Mon May 23 17:54:06 2022] GET /identity/v3/role_assignments?group.id=2acb4a44d6094655b2f6d635738bc3e4&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=66b09c60197a4a1fb2cca5402bb83375 => generated 260 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:06.494351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a1aee-1072-4792-8487-6eedaeb1babe None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:06.566285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3dced-f774-4a1d-9b27-59c98d7a8d07 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.566944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3dced-f774-4a1d-9b27-59c98d7a8d07 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.567426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3dced-f774-4a1d-9b27-59c98d7a8d07 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:06.568107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:06.570239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 195/379] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:06.580979 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27515b-73c7-4480-b681-64bdb06f9324 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.581580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27515b-73c7-4480-b681-64bdb06f9324 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.582037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27515b-73c7-4480-b681-64bdb06f9324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:06.606980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a1aee-1072-4792-8487-6eedaeb1babe None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:06.644430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bc27515b-73c7-4480-b681-64bdb06f9324 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:06.645963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bc27515b-73c7-4480-b681-64bdb06f9324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:06.647302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff35b-464d-4519-8648-be57b71b9956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:06.648182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff35b-464d-4519-8648-be57b71b9956 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.648463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff35b-464d-4519-8648-be57b71b9956 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.648734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff35b-464d-4519-8648-be57b71b9956 None admin] PATH_INFO: `/v3/groups/8749fece5ea1456898d05aac2a1d72d9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:06.655516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ff35b-464d-4519-8648-be57b71b9956 None admin] RBAC: Authorizing `identity:get_group(group_id=8749fece5ea1456898d05aac2a1d72d9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:06.658115 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ff35b-464d-4519-8648-be57b71b9956 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:06.660395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 185/380] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:06 2022] GET /identity/v3/groups/8749fece5ea1456898d05aac2a1d72d9 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:06.666908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff35b-464d-4519-8648-be57b71b9956 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:06.673578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:06.767335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 196/381] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 23 17:54:06.791542 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27515b-73c7-4480-b681-64bdb06f9324 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:06.801608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff35b-464d-4519-8648-be57b71b9956 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:06.834260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:06.841013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28587919-5682-412d-9eeb-f867e8b27456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:06.841791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28587919-5682-412d-9eeb-f867e8b27456 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.842078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28587919-5682-412d-9eeb-f867e8b27456 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.842362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28587919-5682-412d-9eeb-f867e8b27456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:06.843214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28587919-5682-412d-9eeb-f867e8b27456 None admin] RBAC: Adding query filter params (group.id=8749fece5ea1456898d05aac2a1d72d9, role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=883a3e766acb4bf0a201fc243774389f) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:06.843525 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28587919-5682-412d-9eeb-f867e8b27456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:06.845078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28587919-5682-412d-9eeb-f867e8b27456 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:06.851603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 186/382] 10.222.0.30 () {56 vars in 1376 bytes} [Mon May 23 17:54:06 2022] GET /identity/v3/role_assignments?group.id=8749fece5ea1456898d05aac2a1d72d9&scope.project.id=883a3e766acb4bf0a201fc243774389f&role.id=af8084c48e3c40298e26d44d6d14595a => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:06.910101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27515b-73c7-4480-b681-64bdb06f9324 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:06.950142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca739f-e55b-4fff-bc09-0bebba8ede1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:06.951354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca739f-e55b-4fff-bc09-0bebba8ede1c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.951850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca739f-e55b-4fff-bc09-0bebba8ede1c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.952351 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca739f-e55b-4fff-bc09-0bebba8ede1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:06.964943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca739f-e55b-4fff-bc09-0bebba8ede1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-60ca739f-e55b-4fff-bc09-0bebba8ede1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:06.973496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:06.974468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:06.975340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:06.978156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 197/383] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:06.980176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26fd24-0dec-47d7-8238-501a5c76466a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.980635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26fd24-0dec-47d7-8238-501a5c76466a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.980635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26fd24-0dec-47d7-8238-501a5c76466a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:06.982430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 187/384] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:06.985611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca739f-e55b-4fff-bc09-0bebba8ede1c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:06.989041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772528-4a19-47e7-9e7a-d6299487d331 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:06.989330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772528-4a19-47e7-9e7a-d6299487d331 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:06.989637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772528-4a19-47e7-9e7a-d6299487d331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:07.009435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:07.010074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-92772528-4a19-47e7-9e7a-d6299487d331 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:07.011876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-92772528-4a19-47e7-9e7a-d6299487d331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:07.101572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca739f-e55b-4fff-bc09-0bebba8ede1c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:07.120685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 188/385] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:07.139293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffa14f-5f4c-49e6-8c6d-4787264dd564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:07.140344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa14f-5f4c-49e6-8c6d-4787264dd564 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:07.140828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa14f-5f4c-49e6-8c6d-4787264dd564 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:07.141334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa14f-5f4c-49e6-8c6d-4787264dd564 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:07.142286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffa14f-5f4c-49e6-8c6d-4787264dd564 None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:07.142825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffa14f-5f4c-49e6-8c6d-4787264dd564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:07.144424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffa14f-5f4c-49e6-8c6d-4787264dd564 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:07.157900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 198/386] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:54:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:07.159079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92772528-4a19-47e7-9e7a-d6299487d331 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:07.160871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffa14f-5f4c-49e6-8c6d-4787264dd564 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:07.235152 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:07.268615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffa14f-5f4c-49e6-8c6d-4787264dd564 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:07.305043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05306c1a-df00-418a-bad5-61d08891552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:07.305939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306c1a-df00-418a-bad5-61d08891552a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:07.306223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306c1a-df00-418a-bad5-61d08891552a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:07.306498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306c1a-df00-418a-bad5-61d08891552a None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:07.307806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05306c1a-df00-418a-bad5-61d08891552a None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:07.309319 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05306c1a-df00-418a-bad5-61d08891552a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:07.311426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 199/387] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:07 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:07.316923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05306c1a-df00-418a-bad5-61d08891552a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:07.338203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92772528-4a19-47e7-9e7a-d6299487d331 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:07.375795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:07.392422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f9aaf-ad68-489c-97f5-538205b41265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:07.393476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9aaf-ad68-489c-97f5-538205b41265 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:07.393881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9aaf-ad68-489c-97f5-538205b41265 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:07.394256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9aaf-ad68-489c-97f5-538205b41265 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:07.416259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f9aaf-ad68-489c-97f5-538205b41265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-e42f9aaf-ad68-489c-97f5-538205b41265 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:07.425847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:07.426822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:07.427627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:07.430755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 189/388] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:54:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:07.435420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05306c1a-df00-418a-bad5-61d08891552a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:07.437052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f9aaf-ad68-489c-97f5-538205b41265 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:07.473235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ceb97-900f-44ea-a4ba-aeecb81ffc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:07.474492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ceb97-900f-44ea-a4ba-aeecb81ffc21 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:07.474951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ceb97-900f-44ea-a4ba-aeecb81ffc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:07.475453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ceb97-900f-44ea-a4ba-aeecb81ffc21 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:07.476926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ceb97-900f-44ea-a4ba-aeecb81ffc21 None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:07.478601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ceb97-900f-44ea-a4ba-aeecb81ffc21 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:07.481160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 200/389] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:07 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:07.486971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ceb97-900f-44ea-a4ba-aeecb81ffc21 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:07.491044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:07.600222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ceb97-900f-44ea-a4ba-aeecb81ffc21 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:07.631221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f9aaf-ad68-489c-97f5-538205b41265 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:07.640012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680842a3-426a-4672-9258-f695a251322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:07.641227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680842a3-426a-4672-9258-f695a251322b None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:07.641910 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680842a3-426a-4672-9258-f695a251322b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:07.642417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680842a3-426a-4672-9258-f695a251322b None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5/groups/2acb4a44d6094655b2f6d635738bc3e4/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:07.644583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680842a3-426a-4672-9258-f695a251322b None admin] RBAC: Authorizing `identity:create_grant(project_id=784d0612b566498b8205942e82777be5, group_id=2acb4a44d6094655b2f6d635738bc3e4, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:07.646159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680842a3-426a-4672-9258-f695a251322b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:07.663978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 201/390] 10.222.0.30 () {58 vars in 1442 bytes} [Mon May 23 17:54:07 2022] PUT /identity/v3/projects/784d0612b566498b8205942e82777be5/groups/2acb4a44d6094655b2f6d635738bc3e4/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:54:07.705209 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbfebd-25ec-4ba9-b847-778d6166e8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:07.705914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbfebd-25ec-4ba9-b847-778d6166e8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:07.706198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbfebd-25ec-4ba9-b847-778d6166e8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:07.706476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbfebd-25ec-4ba9-b847-778d6166e8d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:07.707269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbfebd-25ec-4ba9-b847-778d6166e8d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:07.707576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbfebd-25ec-4ba9-b847-778d6166e8d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:07.709072 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbfebd-25ec-4ba9-b847-778d6166e8d5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:07.719602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 190/391] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:07.725626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680842a3-426a-4672-9258-f695a251322b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:07.807170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:07.861837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680842a3-426a-4672-9258-f695a251322b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:07.905999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf088b-5a9b-4b40-81c3-b086457a4b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:07.907151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf088b-5a9b-4b40-81c3-b086457a4b71 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:07.907583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf088b-5a9b-4b40-81c3-b086457a4b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:07.908003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf088b-5a9b-4b40-81c3-b086457a4b71 None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:07.909354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf088b-5a9b-4b40-81c3-b086457a4b71 None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:07.911043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf088b-5a9b-4b40-81c3-b086457a4b71 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:07.913176 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 202/392] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:07 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:07.918955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbfebd-25ec-4ba9-b847-778d6166e8d5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:07.993495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:08.056286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbfebd-25ec-4ba9-b847-778d6166e8d5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:08.096588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249b42a-4779-4d37-bdc4-dea5dee3f7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:08.097455 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249b42a-4779-4d37-bdc4-dea5dee3f7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:08.097734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249b42a-4779-4d37-bdc4-dea5dee3f7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:08.098005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249b42a-4779-4d37-bdc4-dea5dee3f7e6 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:08.100492 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249b42a-4779-4d37-bdc4-dea5dee3f7e6 None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:08.101930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249b42a-4779-4d37-bdc4-dea5dee3f7e6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:08.103969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 191/393] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:07 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:08.109518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf088b-5a9b-4b40-81c3-b086457a4b71 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:08.222249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf088b-5a9b-4b40-81c3-b086457a4b71 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:08.256063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:08.262680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db235593-3952-48c8-922a-e24381f2109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:08.263965 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235593-3952-48c8-922a-e24381f2109f None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:08.264427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235593-3952-48c8-922a-e24381f2109f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:08.264896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235593-3952-48c8-922a-e24381f2109f None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5/groups/2acb4a44d6094655b2f6d635738bc3e4/roles/66b09c60197a4a1fb2cca5402bb83375` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:08.267469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db235593-3952-48c8-922a-e24381f2109f None admin] RBAC: Authorizing `identity:create_grant(project_id=784d0612b566498b8205942e82777be5, group_id=2acb4a44d6094655b2f6d635738bc3e4, role_id=66b09c60197a4a1fb2cca5402bb83375)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:08.269202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db235593-3952-48c8-922a-e24381f2109f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:08.293554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 203/394] 10.222.0.30 () {58 vars in 1442 bytes} [Mon May 23 17:54:08 2022] PUT /identity/v3/projects/784d0612b566498b8205942e82777be5/groups/2acb4a44d6094655b2f6d635738bc3e4/roles/66b09c60197a4a1fb2cca5402bb83375 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:08.950518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277573-7eaa-41ec-9b17-54c2590a4a52 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:08.950912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277573-7eaa-41ec-9b17-54c2590a4a52 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:08.951111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277573-7eaa-41ec-9b17-54c2590a4a52 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:08.952734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 192/395] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:08.959037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456254b-8311-4b59-9e96-3e7d27252626 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:08.959474 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456254b-8311-4b59-9e96-3e7d27252626 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:08.959646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456254b-8311-4b59-9e96-3e7d27252626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:08.981311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2456254b-8311-4b59-9e96-3e7d27252626 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:08.982517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2456254b-8311-4b59-9e96-3e7d27252626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:09.063161 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 204/396] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:09.084632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277573-7eaa-41ec-9b17-54c2590a4a52 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:09.219548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277573-7eaa-41ec-9b17-54c2590a4a52 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:09.246059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:09.268190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d36abf-dfcd-4659-8bbc-5e3ba8f680f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:09.268995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d36abf-dfcd-4659-8bbc-5e3ba8f680f4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:09.269278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d36abf-dfcd-4659-8bbc-5e3ba8f680f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:09.269552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d36abf-dfcd-4659-8bbc-5e3ba8f680f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:09.282065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d36abf-dfcd-4659-8bbc-5e3ba8f680f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-25d36abf-dfcd-4659-8bbc-5e3ba8f680f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:09.291842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:09.293275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:09.294067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:09.294672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 193/397] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:09.299806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456254b-8311-4b59-9e96-3e7d27252626 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:09.412095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456254b-8311-4b59-9e96-3e7d27252626 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:09.441467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:09.453954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74dd5-e2fd-4353-bffa-b343bc68a8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:09.454645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74dd5-e2fd-4353-bffa-b343bc68a8bc None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:09.455156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74dd5-e2fd-4353-bffa-b343bc68a8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:09.455680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74dd5-e2fd-4353-bffa-b343bc68a8bc None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:09.456677 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74dd5-e2fd-4353-bffa-b343bc68a8bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:09.456988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74dd5-e2fd-4353-bffa-b343bc68a8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:09.458355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74dd5-e2fd-4353-bffa-b343bc68a8bc None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:09.469706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 205/398] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:54:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:09.475247 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d36abf-dfcd-4659-8bbc-5e3ba8f680f4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:09.595180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d36abf-dfcd-4659-8bbc-5e3ba8f680f4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:09.651450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bb63a-815e-461a-9d6c-235fc525e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:09.652477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bb63a-815e-461a-9d6c-235fc525e76d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:09.652771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bb63a-815e-461a-9d6c-235fc525e76d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:09.653055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bb63a-815e-461a-9d6c-235fc525e76d None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:09.654317 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bb63a-815e-461a-9d6c-235fc525e76d None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:09.655802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bb63a-815e-461a-9d6c-235fc525e76d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:09.657440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 194/399] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:09 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:09.662955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74dd5-e2fd-4353-bffa-b343bc68a8bc None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:09.809777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74dd5-e2fd-4353-bffa-b343bc68a8bc None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:09.852753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ab01c-4bf2-44d0-8efa-817dfa8d8ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:09.853620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ab01c-4bf2-44d0-8efa-817dfa8d8ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:09.853905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ab01c-4bf2-44d0-8efa-817dfa8d8ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:09.854182 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ab01c-4bf2-44d0-8efa-817dfa8d8ce8 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:09.859451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ab01c-4bf2-44d0-8efa-817dfa8d8ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:09.860913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ab01c-4bf2-44d0-8efa-817dfa8d8ce8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:09.863002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 206/400] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:09 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:09.868302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bb63a-815e-461a-9d6c-235fc525e76d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:09.939573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:10.009371 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bb63a-815e-461a-9d6c-235fc525e76d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:10.020506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343f58a-c132-42f1-a05f-3ff08049d3f7 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.021003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343f58a-c132-42f1-a05f-3ff08049d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.021075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343f58a-c132-42f1-a05f-3ff08049d3f7 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.022844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 207/401] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:10.028266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9effb9b-54d0-4efd-bcc0-ddf1351e4b22 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.028625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9effb9b-54d0-4efd-bcc0-ddf1351e4b22 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.028969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9effb9b-54d0-4efd-bcc0-ddf1351e4b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.048843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d9effb9b-54d0-4efd-bcc0-ddf1351e4b22 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:10.050952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f7e05-39c0-4d02-8e4d-42f3d824f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:10.051374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d9effb9b-54d0-4efd-bcc0-ddf1351e4b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:10.052231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7e05-39c0-4d02-8e4d-42f3d824f4e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.052670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7e05-39c0-4d02-8e4d-42f3d824f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.053091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7e05-39c0-4d02-8e4d-42f3d824f4e6 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14/groups/2acb4a44d6094655b2f6d635738bc3e4/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.055575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f7e05-39c0-4d02-8e4d-42f3d824f4e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f89df535b56543e3b83b59bc617ffd14, group_id=2acb4a44d6094655b2f6d635738bc3e4, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:10.057215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f7e05-39c0-4d02-8e4d-42f3d824f4e6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:10.075271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 195/402] 10.222.0.30 () {58 vars in 1442 bytes} [Mon May 23 17:54:09 2022] PUT /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14/groups/2acb4a44d6094655b2f6d635738bc3e4/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:10.076884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209864-0516-4baf-bbbb-304e2eac67f3 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.077341 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209864-0516-4baf-bbbb-304e2eac67f3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.077769 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209864-0516-4baf-bbbb-304e2eac67f3 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.080806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 196/403] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:10.087527 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd0e1a-6726-40f7-8b7f-9189ea6d4fda None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.088584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd0e1a-6726-40f7-8b7f-9189ea6d4fda None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.089571 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd0e1a-6726-40f7-8b7f-9189ea6d4fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.123954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e3dd0e1a-6726-40f7-8b7f-9189ea6d4fda None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:10.125200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e3dd0e1a-6726-40f7-8b7f-9189ea6d4fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:10.131248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:10.138503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 208/404] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:10.162553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9effb9b-54d0-4efd-bcc0-ddf1351e4b22 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:10.214800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 197/405] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:10.239804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd0e1a-6726-40f7-8b7f-9189ea6d4fda None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:10.292883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9effb9b-54d0-4efd-bcc0-ddf1351e4b22 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:10.294622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:10.329400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d3e2-681e-403d-9f80-3ecf24e4f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:10.330142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d3e2-681e-403d-9f80-3ecf24e4f12f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.330426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d3e2-681e-403d-9f80-3ecf24e4f12f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.330714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d3e2-681e-403d-9f80-3ecf24e4f12f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.344502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530d3e2-681e-403d-9f80-3ecf24e4f12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-a530d3e2-681e-403d-9f80-3ecf24e4f12f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:10.355912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:10.356880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:10.357693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:10.362750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 209/406] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:54:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:10.367242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d3e2-681e-403d-9f80-3ecf24e4f12f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:10.442386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd0e1a-6726-40f7-8b7f-9189ea6d4fda None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:10.451136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:10.492774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51922766-d7bb-4e86-b0a1-6855ef089b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:10.493922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51922766-d7bb-4e86-b0a1-6855ef089b8e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.494404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51922766-d7bb-4e86-b0a1-6855ef089b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.494889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51922766-d7bb-4e86-b0a1-6855ef089b8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.507548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51922766-d7bb-4e86-b0a1-6855ef089b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-51922766-d7bb-4e86-b0a1-6855ef089b8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:10.516932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:10.517898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:10.518685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:10.521397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 198/407] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:10.532102 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51922766-d7bb-4e86-b0a1-6855ef089b8e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:10.576877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d3e2-681e-403d-9f80-3ecf24e4f12f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:10.613706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1f8b6-0fc0-4821-abbf-79f8765d3795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:10.614717 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1f8b6-0fc0-4821-abbf-79f8765d3795 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.615201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1f8b6-0fc0-4821-abbf-79f8765d3795 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.615691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1f8b6-0fc0-4821-abbf-79f8765d3795 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.616638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1f8b6-0fc0-4821-abbf-79f8765d3795 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:10.617159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1f8b6-0fc0-4821-abbf-79f8765d3795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:10.618790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1f8b6-0fc0-4821-abbf-79f8765d3795 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:10.628654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 210/408] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:10.630318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bf3c-5e9f-4808-8716-2fc7473cdadd None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.630831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bf3c-5e9f-4808-8716-2fc7473cdadd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.631460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bf3c-5e9f-4808-8716-2fc7473cdadd None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.633015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 211/409] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:10.634198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6bf3c-5e9f-4808-8716-2fc7473cdadd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:10.665423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:10.678222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51922766-d7bb-4e86-b0a1-6855ef089b8e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:10.717871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda27fcc-3b55-46c6-8dbe-a4895258e004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:10.718962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda27fcc-3b55-46c6-8dbe-a4895258e004 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.719510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda27fcc-3b55-46c6-8dbe-a4895258e004 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.720018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda27fcc-3b55-46c6-8dbe-a4895258e004 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.721050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda27fcc-3b55-46c6-8dbe-a4895258e004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:10.721556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda27fcc-3b55-46c6-8dbe-a4895258e004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:10.723455 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda27fcc-3b55-46c6-8dbe-a4895258e004 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:10.738233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 199/410] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:10.739940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22773b1-ce0b-44c8-a0a2-72933364e5b7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.740467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22773b1-ce0b-44c8-a0a2-72933364e5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.740971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22773b1-ce0b-44c8-a0a2-72933364e5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.752447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6bf3c-5e9f-4808-8716-2fc7473cdadd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:10.755009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:10.760192 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d22773b1-ce0b-44c8-a0a2-72933364e5b7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:10.762401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d22773b1-ce0b-44c8-a0a2-72933364e5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:10.790878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1dac-0715-4bd9-8a4e-c7c48c1f3454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:10.791833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1dac-0715-4bd9-8a4e-c7c48c1f3454 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.792868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1dac-0715-4bd9-8a4e-c7c48c1f3454 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.793157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1dac-0715-4bd9-8a4e-c7c48c1f3454 None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.794376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e1dac-0715-4bd9-8a4e-c7c48c1f3454 None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:10.795952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e1dac-0715-4bd9-8a4e-c7c48c1f3454 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:10.797730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 212/411] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:10 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:10.798492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1dac-0715-4bd9-8a4e-c7c48c1f3454 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:10.837721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 200/412] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:10.839055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22773b1-ce0b-44c8-a0a2-72933364e5b7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:10.928628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1dac-0715-4bd9-8a4e-c7c48c1f3454 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:10.945217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22773b1-ce0b-44c8-a0a2-72933364e5b7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:10.949246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:10.963359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81fc2c-f0ed-48fe-aeb0-a381229427f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:10.964383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81fc2c-f0ed-48fe-aeb0-a381229427f4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.964677 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81fc2c-f0ed-48fe-aeb0-a381229427f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.964952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81fc2c-f0ed-48fe-aeb0-a381229427f4 None admin] PATH_INFO: `/v3/groups/8749fece5ea1456898d05aac2a1d72d9` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.966628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81fc2c-f0ed-48fe-aeb0-a381229427f4 None admin] RBAC: Authorizing `identity:get_group(group_id=8749fece5ea1456898d05aac2a1d72d9)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:10.968464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81fc2c-f0ed-48fe-aeb0-a381229427f4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:10.970439 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 213/413] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:10 2022] GET /identity/v3/groups/8749fece5ea1456898d05aac2a1d72d9 => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:10.974859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81fc2c-f0ed-48fe-aeb0-a381229427f4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:10.990280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d7a5d-ca69-45e2-bdb9-49aa36179e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:10.991568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d7a5d-ca69-45e2-bdb9-49aa36179e8b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:10.992281 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d7a5d-ca69-45e2-bdb9-49aa36179e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:10.992737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d7a5d-ca69-45e2-bdb9-49aa36179e8b None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:10.994270 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d7a5d-ca69-45e2-bdb9-49aa36179e8b None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:10.996612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d7a5d-ca69-45e2-bdb9-49aa36179e8b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:10.998991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 201/414] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:10 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:11.000107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d7a5d-ca69-45e2-bdb9-49aa36179e8b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:11.016766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:11.079888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81fc2c-f0ed-48fe-aeb0-a381229427f4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:11.111071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d7a5d-ca69-45e2-bdb9-49aa36179e8b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:11.114884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7ddb-5306-4f0f-b738-1bfbafd8b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:11.115685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7ddb-5306-4f0f-b738-1bfbafd8b045 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:11.115969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7ddb-5306-4f0f-b738-1bfbafd8b045 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:11.116244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7ddb-5306-4f0f-b738-1bfbafd8b045 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:11.128102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e7ddb-5306-4f0f-b738-1bfbafd8b045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b36e7ddb-5306-4f0f-b738-1bfbafd8b045 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:11.136947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:11.137967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:11.138789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:11.142997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 214/415] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:11.143805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7ddb-5306-4f0f-b738-1bfbafd8b045 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:11.155762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e98eb-7664-4408-aef3-d7de5fb21f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:11.156967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e98eb-7664-4408-aef3-d7de5fb21f32 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:11.157518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e98eb-7664-4408-aef3-d7de5fb21f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:11.157989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e98eb-7664-4408-aef3-d7de5fb21f32 None admin] PATH_INFO: `/v3/projects/883a3e766acb4bf0a201fc243774389f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:11.159427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e98eb-7664-4408-aef3-d7de5fb21f32 None admin] RBAC: Authorizing `identity:get_project(project_id=883a3e766acb4bf0a201fc243774389f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:11.161546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e98eb-7664-4408-aef3-d7de5fb21f32 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:11.163616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 202/416] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:10 2022] GET /identity/v3/projects/883a3e766acb4bf0a201fc243774389f => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:11.164708 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e98eb-7664-4408-aef3-d7de5fb21f32 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:11.215673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:11.245942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:11.249894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7ddb-5306-4f0f-b738-1bfbafd8b045 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:11.276851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e98eb-7664-4408-aef3-d7de5fb21f32 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:11.288019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f351b-c44d-4ddf-abde-afb92f9c21bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:11.289109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f351b-c44d-4ddf-abde-afb92f9c21bb None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:11.289498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f351b-c44d-4ddf-abde-afb92f9c21bb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:11.290086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f351b-c44d-4ddf-abde-afb92f9c21bb None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14/groups/2acb4a44d6094655b2f6d635738bc3e4/roles/66b09c60197a4a1fb2cca5402bb83375` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:11.292316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f351b-c44d-4ddf-abde-afb92f9c21bb None admin] RBAC: Authorizing `identity:create_grant(project_id=f89df535b56543e3b83b59bc617ffd14, group_id=2acb4a44d6094655b2f6d635738bc3e4, role_id=66b09c60197a4a1fb2cca5402bb83375)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:11.293887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f351b-c44d-4ddf-abde-afb92f9c21bb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:11.312702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 215/417] 10.222.0.30 () {58 vars in 1442 bytes} [Mon May 23 17:54:11 2022] PUT /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14/groups/2acb4a44d6094655b2f6d635738bc3e4/roles/66b09c60197a4a1fb2cca5402bb83375 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:11.313872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f351b-c44d-4ddf-abde-afb92f9c21bb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:11.320133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9d4c9-39ef-4c58-81bb-606ae4c97c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:11.321069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d4c9-39ef-4c58-81bb-606ae4c97c5d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:11.321584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d4c9-39ef-4c58-81bb-606ae4c97c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:11.322001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d4c9-39ef-4c58-81bb-606ae4c97c5d None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:11.323037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9d4c9-39ef-4c58-81bb-606ae4c97c5d None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:11.324288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9d4c9-39ef-4c58-81bb-606ae4c97c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:11.326096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9d4c9-39ef-4c58-81bb-606ae4c97c5d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:11.342641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 203/418] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:54:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:11.344380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9d4c9-39ef-4c58-81bb-606ae4c97c5d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:11.457888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:11.466135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f351b-c44d-4ddf-abde-afb92f9c21bb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:11.507611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d0d28-5f31-4ba4-b09c-eb3d4b6e6995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:11.509124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0d28-5f31-4ba4-b09c-eb3d4b6e6995 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:11.509650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0d28-5f31-4ba4-b09c-eb3d4b6e6995 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:11.510126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d0d28-5f31-4ba4-b09c-eb3d4b6e6995 None admin] PATH_INFO: `/v3/projects/883a3e766acb4bf0a201fc243774389f/groups/8749fece5ea1456898d05aac2a1d72d9/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:11.513424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d0d28-5f31-4ba4-b09c-eb3d4b6e6995 None admin] RBAC: Authorizing `identity:create_grant(project_id=883a3e766acb4bf0a201fc243774389f, group_id=8749fece5ea1456898d05aac2a1d72d9, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:11.515322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d0d28-5f31-4ba4-b09c-eb3d4b6e6995 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:11.517074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9d4c9-39ef-4c58-81bb-606ae4c97c5d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:11.536608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 216/419] 10.222.0.30 () {58 vars in 1442 bytes} [Mon May 23 17:54:11 2022] PUT /identity/v3/projects/883a3e766acb4bf0a201fc243774389f/groups/8749fece5ea1456898d05aac2a1d72d9/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:11.585683 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645445dd-8231-485c-927a-52095eb12556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:11.586349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645445dd-8231-485c-927a-52095eb12556 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:11.586690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645445dd-8231-485c-927a-52095eb12556 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:11.587051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645445dd-8231-485c-927a-52095eb12556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:11.613069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e43825-5b2b-4196-af29-fe7dd11834da None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:11.613808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e43825-5b2b-4196-af29-fe7dd11834da None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:11.614289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e43825-5b2b-4196-af29-fe7dd11834da None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:11.617076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 217/420] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:54:11.623491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dca4b8-4900-4b83-ac0d-b027ca2e1b0a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:11.624211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dca4b8-4900-4b83-ac0d-b027ca2e1b0a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:11.624717 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dca4b8-4900-4b83-ac0d-b027ca2e1b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:11.648344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-59dca4b8-4900-4b83-ac0d-b027ca2e1b0a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:11.650031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-59dca4b8-4900-4b83-ac0d-b027ca2e1b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:11.669736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:11.670729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645445dd-8231-485c-927a-52095eb12556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:11.672485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645445dd-8231-485c-927a-52095eb12556 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:11.762857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 218/421] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:11.783977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dca4b8-4900-4b83-ac0d-b027ca2e1b0a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:11.784610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:11.812287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 204/422] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:11.820340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645445dd-8231-485c-927a-52095eb12556 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:11.934669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dca4b8-4900-4b83-ac0d-b027ca2e1b0a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:11.939311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645445dd-8231-485c-927a-52095eb12556 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:11.977202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae9aca-f4fc-4a42-89a6-4030d86c0d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:11.978012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae9aca-f4fc-4a42-89a6-4030d86c0d5a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:11.978297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae9aca-f4fc-4a42-89a6-4030d86c0d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:11.978568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae9aca-f4fc-4a42-89a6-4030d86c0d5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:11.999468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae9aca-f4fc-4a42-89a6-4030d86c0d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:12.012772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c10c-b2b2-43f2-8804-5e5fb3ecf0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:12.013694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c10c-b2b2-43f2-8804-5e5fb3ecf0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:12.013918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c10c-b2b2-43f2-8804-5e5fb3ecf0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:12.014193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c10c-b2b2-43f2-8804-5e5fb3ecf0a3 None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:12.015456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c10c-b2b2-43f2-8804-5e5fb3ecf0a3 None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:12.017022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c10c-b2b2-43f2-8804-5e5fb3ecf0a3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:12.018748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 205/423] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:11 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-81ae9aca-f4fc-4a42-89a6-4030d86c0d5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:12.023189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:12.024069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:12.024870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 219/424] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:54:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:12.027021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c10c-b2b2-43f2-8804-5e5fb3ecf0a3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:12.032388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae9aca-f4fc-4a42-89a6-4030d86c0d5a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:12.052774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:12.120059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:12.220585 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c10c-b2b2-43f2-8804-5e5fb3ecf0a3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:12.235201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae9aca-f4fc-4a42-89a6-4030d86c0d5a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:12.275354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c56acb-1a97-447b-bdf4-71268fd2edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:12.275937 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56acb-1a97-447b-bdf4-71268fd2edfb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:12.276217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56acb-1a97-447b-bdf4-71268fd2edfb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:12.276574 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56acb-1a97-447b-bdf4-71268fd2edfb None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:12.277437 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c56acb-1a97-447b-bdf4-71268fd2edfb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:12.277749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c56acb-1a97-447b-bdf4-71268fd2edfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:12.279473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c56acb-1a97-447b-bdf4-71268fd2edfb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:12.289643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 220/425] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:12.290794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbf7f9-7bd6-499a-ae25-8080d283a8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:12.292421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbf7f9-7bd6-499a-ae25-8080d283a8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:12.292874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbf7f9-7bd6-499a-ae25-8080d283a8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:12.293359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbf7f9-7bd6-499a-ae25-8080d283a8e1 None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:12.299015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbf7f9-7bd6-499a-ae25-8080d283a8e1 None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:12.299359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c56acb-1a97-447b-bdf4-71268fd2edfb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:12.301067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbf7f9-7bd6-499a-ae25-8080d283a8e1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:12.303253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 206/426] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:12 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:12.309440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbf7f9-7bd6-499a-ae25-8080d283a8e1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:12.435544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:12.471623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbf7f9-7bd6-499a-ae25-8080d283a8e1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:12.489295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c56acb-1a97-447b-bdf4-71268fd2edfb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:12.520097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:12.533464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8d75-8e9b-4f92-94cd-c5dfbf0e5d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:12.534431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8d75-8e9b-4f92-94cd-c5dfbf0e5d5f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:12.534962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8d75-8e9b-4f92-94cd-c5dfbf0e5d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:12.535458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8d75-8e9b-4f92-94cd-c5dfbf0e5d5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:12.586169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf20615-58e0-497d-8d3b-b549e9def897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:12.586854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf20615-58e0-497d-8d3b-b549e9def897 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:12.587139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf20615-58e0-497d-8d3b-b549e9def897 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:12.587411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf20615-58e0-497d-8d3b-b549e9def897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:12.588241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf20615-58e0-497d-8d3b-b549e9def897 None admin] RBAC: Adding query filter params (group.id=2acb4a44d6094655b2f6d635738bc3e4, role.id=bce93d0b549349079c3292eb120d54c1, scope.project.id=784d0612b566498b8205942e82777be5) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:12.588549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf20615-58e0-497d-8d3b-b549e9def897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:12.590333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf20615-58e0-497d-8d3b-b549e9def897 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:12.596907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 207/427] 10.222.0.30 () {56 vars in 1376 bytes} [Mon May 23 17:54:12 2022] GET /identity/v3/role_assignments?group.id=2acb4a44d6094655b2f6d635738bc3e4&scope.project.id=784d0612b566498b8205942e82777be5&role.id=bce93d0b549349079c3292eb120d54c1 => generated 611 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:12.644742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa8d75-8e9b-4f92-94cd-c5dfbf0e5d5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:12.646258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa8d75-8e9b-4f92-94cd-c5dfbf0e5d5f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:12.763146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:12.797719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 221/428] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:12.803799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf20615-58e0-497d-8d3b-b549e9def897 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:12.925131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf20615-58e0-497d-8d3b-b549e9def897 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:12.967562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb65e-a242-454f-bc73-e8c8a1c776ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:12.968466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb65e-a242-454f-bc73-e8c8a1c776ca None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:12.968746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb65e-a242-454f-bc73-e8c8a1c776ca None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:12.969017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb65e-a242-454f-bc73-e8c8a1c776ca None admin] PATH_INFO: `/v3/projects/784d0612b566498b8205942e82777be5` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:12.970318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cb65e-a242-454f-bc73-e8c8a1c776ca None admin] RBAC: Authorizing `identity:get_project(project_id=784d0612b566498b8205942e82777be5)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:12.971879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cb65e-a242-454f-bc73-e8c8a1c776ca None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:12.973948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 208/429] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:12 2022] GET /identity/v3/projects/784d0612b566498b8205942e82777be5 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:12.974246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358acf8-ae88-40f3-962e-cdbbc0ee1afa None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:12.974545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358acf8-ae88-40f3-962e-cdbbc0ee1afa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:12.974860 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358acf8-ae88-40f3-962e-cdbbc0ee1afa None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:12.976526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 222/430] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:12.980947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb65e-a242-454f-bc73-e8c8a1c776ca None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:12.985312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac968c-ade1-476b-b7b8-4515c94915d3 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:12.986633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac968c-ade1-476b-b7b8-4515c94915d3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:12.987136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac968c-ade1-476b-b7b8-4515c94915d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:13.013875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-55ac968c-ade1-476b-b7b8-4515c94915d3 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:13.015330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-55ac968c-ade1-476b-b7b8-4515c94915d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:13.039215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:13.098484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb65e-a242-454f-bc73-e8c8a1c776ca None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:13.109978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 223/431] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:13.148233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac968c-ade1-476b-b7b8-4515c94915d3 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:13.150667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99522055-6c56-46d5-b835-aa2295f16982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:13.152249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99522055-6c56-46d5-b835-aa2295f16982 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:13.152647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99522055-6c56-46d5-b835-aa2295f16982 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:13.153006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99522055-6c56-46d5-b835-aa2295f16982 None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:13.156624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99522055-6c56-46d5-b835-aa2295f16982 None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:13.158272 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99522055-6c56-46d5-b835-aa2295f16982 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:13.160269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 209/432] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:12 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:13.165803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99522055-6c56-46d5-b835-aa2295f16982 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:13.293524 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac968c-ade1-476b-b7b8-4515c94915d3 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:13.294566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99522055-6c56-46d5-b835-aa2295f16982 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:13.295190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:13.323619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:13.340699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01916870-19a6-4f41-9d63-abd876822606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:13.341504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01916870-19a6-4f41-9d63-abd876822606 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:13.341789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01916870-19a6-4f41-9d63-abd876822606 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:13.342067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01916870-19a6-4f41-9d63-abd876822606 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:13.346622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d96fb7-2a6f-4f55-add3-b014bebcfeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:13.347350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96fb7-2a6f-4f55-add3-b014bebcfeae None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:13.347636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96fb7-2a6f-4f55-add3-b014bebcfeae None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:13.348016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96fb7-2a6f-4f55-add3-b014bebcfeae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:13.349007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96fb7-2a6f-4f55-add3-b014bebcfeae None admin] RBAC: Adding query filter params (group.id=2acb4a44d6094655b2f6d635738bc3e4, role.id=66b09c60197a4a1fb2cca5402bb83375, scope.project.id=784d0612b566498b8205942e82777be5) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:13.349555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96fb7-2a6f-4f55-add3-b014bebcfeae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:13.351062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96fb7-2a6f-4f55-add3-b014bebcfeae None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:13.353055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01916870-19a6-4f41-9d63-abd876822606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-01916870-19a6-4f41-9d63-abd876822606 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:13.362292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:13.363268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 17:54:13.364086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:13.364704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 210/433] 10.222.0.30 () {56 vars in 1376 bytes} [Mon May 23 17:54:13 2022] GET /identity/v3/role_assignments?group.id=2acb4a44d6094655b2f6d635738bc3e4&scope.project.id=784d0612b566498b8205942e82777be5&role.id=66b09c60197a4a1fb2cca5402bb83375 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:13.364773 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 224/434] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:13.370864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d96fb7-2a6f-4f55-add3-b014bebcfeae None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:13.488917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d96fb7-2a6f-4f55-add3-b014bebcfeae None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:13.538227 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e3c92-cfcf-4359-af1a-45aa1e80611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:13.538969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3c92-cfcf-4359-af1a-45aa1e80611e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:13.539258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3c92-cfcf-4359-af1a-45aa1e80611e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:13.539537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3c92-cfcf-4359-af1a-45aa1e80611e None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:13.540303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e3c92-cfcf-4359-af1a-45aa1e80611e None admin] RBAC: Adding query filter params (name=member) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:13.540614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e3c92-cfcf-4359-af1a-45aa1e80611e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:13.542085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e3c92-cfcf-4359-af1a-45aa1e80611e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:13.554595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 211/435] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:54:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:13.560585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01916870-19a6-4f41-9d63-abd876822606 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:13.680956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01916870-19a6-4f41-9d63-abd876822606 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:13.717229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e45a-f47b-45df-8a3e-33b352a2f1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:13.717882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e45a-f47b-45df-8a3e-33b352a2f1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:13.718166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e45a-f47b-45df-8a3e-33b352a2f1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:13.718441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e45a-f47b-45df-8a3e-33b352a2f1b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:13.750090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:13.795709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924e45a-f47b-45df-8a3e-33b352a2f1b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:13.797173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924e45a-f47b-45df-8a3e-33b352a2f1b0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:13.905319 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 225/436] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:13.910973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e3c92-cfcf-4359-af1a-45aa1e80611e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:13.965090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:14.023846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e3c92-cfcf-4359-af1a-45aa1e80611e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:14.058191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca50f1-1b3c-4926-9ea8-b4c41fd3fbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:14.059180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca50f1-1b3c-4926-9ea8-b4c41fd3fbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.059468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca50f1-1b3c-4926-9ea8-b4c41fd3fbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.059747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca50f1-1b3c-4926-9ea8-b4c41fd3fbf5 None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.060988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca50f1-1b3c-4926-9ea8-b4c41fd3fbf5 None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:14.062444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca50f1-1b3c-4926-9ea8-b4c41fd3fbf5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:14.064331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 212/437] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:13 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:14.069714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e45a-f47b-45df-8a3e-33b352a2f1b0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:14.131778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:14.136649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd67643-6a72-4706-8115-824c76986fad None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.136929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd67643-6a72-4706-8115-824c76986fad None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.137205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd67643-6a72-4706-8115-824c76986fad None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.138748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 213/438] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:14.143875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf8086-f22f-449f-9f17-f59840a4739e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.144170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf8086-f22f-449f-9f17-f59840a4739e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.144450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf8086-f22f-449f-9f17-f59840a4739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.162670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2ccf8086-f22f-449f-9f17-f59840a4739e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:14.164075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2ccf8086-f22f-449f-9f17-f59840a4739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:14.177388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e45a-f47b-45df-8a3e-33b352a2f1b0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:14.210377 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cfedd-c07e-438e-8b4f-b5959c625c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:14.211243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cfedd-c07e-438e-8b4f-b5959c625c95 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.211526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cfedd-c07e-438e-8b4f-b5959c625c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.211797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cfedd-c07e-438e-8b4f-b5959c625c95 None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.212954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cfedd-c07e-438e-8b4f-b5959c625c95 None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:14.215291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cfedd-c07e-438e-8b4f-b5959c625c95 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:14.216849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 226/439] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:14 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:14.218002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121383a-5b93-4c55-9b25-d37de92f44d3 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.218285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121383a-5b93-4c55-9b25-d37de92f44d3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.218857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121383a-5b93-4c55-9b25-d37de92f44d3 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.222834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 227/440] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:14.223737 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121383a-5b93-4c55-9b25-d37de92f44d3 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:14.232498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 214/441] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:14.233931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca88ff2-0bed-4c2b-b4bb-14010d5704ff None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.234224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca88ff2-0bed-4c2b-b4bb-14010d5704ff None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.234500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca88ff2-0bed-4c2b-b4bb-14010d5704ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.255112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6ca88ff2-0bed-4c2b-b4bb-14010d5704ff None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:14.256330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6ca88ff2-0bed-4c2b-b4bb-14010d5704ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:14.293917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:14.326190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121383a-5b93-4c55-9b25-d37de92f44d3 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:14.327324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 215/442] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:14.328158 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca88ff2-0bed-4c2b-b4bb-14010d5704ff None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:14.357158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:14.363176 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101033fd-8946-4313-8a75-58def3282043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:14.363823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101033fd-8946-4313-8a75-58def3282043 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.364105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101033fd-8946-4313-8a75-58def3282043 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.364379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101033fd-8946-4313-8a75-58def3282043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.365197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101033fd-8946-4313-8a75-58def3282043 None admin] RBAC: Adding query filter params (group.id=2acb4a44d6094655b2f6d635738bc3e4, role.id=bce93d0b549349079c3292eb120d54c1, scope.project.id=f89df535b56543e3b83b59bc617ffd14) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:14.365503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101033fd-8946-4313-8a75-58def3282043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:14.366952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101033fd-8946-4313-8a75-58def3282043 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:14.373006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 228/443] 10.222.0.30 () {56 vars in 1376 bytes} [Mon May 23 17:54:14 2022] GET /identity/v3/role_assignments?group.id=2acb4a44d6094655b2f6d635738bc3e4&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=bce93d0b549349079c3292eb120d54c1 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:14.373628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101033fd-8946-4313-8a75-58def3282043 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:14.455755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca88ff2-0bed-4c2b-b4bb-14010d5704ff None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:14.484784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101033fd-8946-4313-8a75-58def3282043 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:14.496339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d951e7-979f-4405-a002-63fd72a3f77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:14.497157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d951e7-979f-4405-a002-63fd72a3f77d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.497449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d951e7-979f-4405-a002-63fd72a3f77d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.497728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d951e7-979f-4405-a002-63fd72a3f77d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.510084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d951e7-979f-4405-a002-63fd72a3f77d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-31d951e7-979f-4405-a002-63fd72a3f77d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:14.520934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:14.521893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:14.522735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 216/444] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:14.526036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d951e7-979f-4405-a002-63fd72a3f77d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:14.536428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fab4-cedb-4d6c-94ad-b92d4eb33fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:14.537248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fab4-cedb-4d6c-94ad-b92d4eb33fec None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.537530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fab4-cedb-4d6c-94ad-b92d4eb33fec None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.537805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fab4-cedb-4d6c-94ad-b92d4eb33fec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.550656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99fab4-cedb-4d6c-94ad-b92d4eb33fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-9e99fab4-cedb-4d6c-94ad-b92d4eb33fec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:14.559695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:14.560834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:14.561830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 229/445] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:54:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:14.567443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:14.568190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fab4-cedb-4d6c-94ad-b92d4eb33fec None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:14.638806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:14.651361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d951e7-979f-4405-a002-63fd72a3f77d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:14.689799 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fab4-cedb-4d6c-94ad-b92d4eb33fec None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:14.694205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924a16a-e1d1-430b-8074-727e64dfc3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:14.694917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924a16a-e1d1-430b-8074-727e64dfc3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.695199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924a16a-e1d1-430b-8074-727e64dfc3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.695469 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924a16a-e1d1-430b-8074-727e64dfc3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.696207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924a16a-e1d1-430b-8074-727e64dfc3b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:14.696507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924a16a-e1d1-430b-8074-727e64dfc3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:14.697872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924a16a-e1d1-430b-8074-727e64dfc3b9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:14.707420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 217/446] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:14.712735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924a16a-e1d1-430b-8074-727e64dfc3b9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:14.730081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c261f-dfe8-4609-b088-b38a79c6376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:14.730868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c261f-dfe8-4609-b088-b38a79c6376e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.731860 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c261f-dfe8-4609-b088-b38a79c6376e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.732141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c261f-dfe8-4609-b088-b38a79c6376e None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.732905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c261f-dfe8-4609-b088-b38a79c6376e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:14.733215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c261f-dfe8-4609-b088-b38a79c6376e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:14.734591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c261f-dfe8-4609-b088-b38a79c6376e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:14.742970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 230/447] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:14.749309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c261f-dfe8-4609-b088-b38a79c6376e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:14.825336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:14.832766 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924a16a-e1d1-430b-8074-727e64dfc3b9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:14.855991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c261f-dfe8-4609-b088-b38a79c6376e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:14.866855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f4666-77ca-43cc-89a5-98be8eb57cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:14.867503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4666-77ca-43cc-89a5-98be8eb57cbf None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.867783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4666-77ca-43cc-89a5-98be8eb57cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.868061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4666-77ca-43cc-89a5-98be8eb57cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.872025 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:14.889998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65cde9-4513-48ea-99db-5d1cd74b0232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:14.890633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65cde9-4513-48ea-99db-5d1cd74b0232 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:14.890950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65cde9-4513-48ea-99db-5d1cd74b0232 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:14.891227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65cde9-4513-48ea-99db-5d1cd74b0232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:14.934805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f4666-77ca-43cc-89a5-98be8eb57cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:14.936280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f4666-77ca-43cc-89a5-98be8eb57cbf None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:14.959077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65cde9-4513-48ea-99db-5d1cd74b0232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:14.960508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65cde9-4513-48ea-99db-5d1cd74b0232 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:15.027258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:15.034979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 218/448] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:54:15.040601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f4666-77ca-43cc-89a5-98be8eb57cbf None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:15.059509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 231/449] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:54:15.064876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65cde9-4513-48ea-99db-5d1cd74b0232 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:15.081094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:15.138389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f4666-77ca-43cc-89a5-98be8eb57cbf None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:15.164172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65cde9-4513-48ea-99db-5d1cd74b0232 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:15.177701 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3073dc3-b422-48d4-aa8f-48f23c78788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:15.178784 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3073dc3-b422-48d4-aa8f-48f23c78788f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:15.179067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3073dc3-b422-48d4-aa8f-48f23c78788f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:15.179342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3073dc3-b422-48d4-aa8f-48f23c78788f None admin] PATH_INFO: `/v3/projects/883a3e766acb4bf0a201fc243774389f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:15.180559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3073dc3-b422-48d4-aa8f-48f23c78788f None admin] RBAC: Authorizing `identity:get_project(project_id=883a3e766acb4bf0a201fc243774389f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:15.182207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3073dc3-b422-48d4-aa8f-48f23c78788f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:15.184165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 219/450] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:15 2022] GET /identity/v3/projects/883a3e766acb4bf0a201fc243774389f => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:15.189907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3073dc3-b422-48d4-aa8f-48f23c78788f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:15.202113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cbde3-1c59-4029-9c9b-2263199fe24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:15.203458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cbde3-1c59-4029-9c9b-2263199fe24f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:15.203887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cbde3-1c59-4029-9c9b-2263199fe24f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:15.204306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cbde3-1c59-4029-9c9b-2263199fe24f None admin] PATH_INFO: `/v3/projects/f89df535b56543e3b83b59bc617ffd14` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:15.206071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cbde3-1c59-4029-9c9b-2263199fe24f None admin] RBAC: Authorizing `identity:get_project(project_id=f89df535b56543e3b83b59bc617ffd14)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:15.208399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cbde3-1c59-4029-9c9b-2263199fe24f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:15.211184 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 232/451] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:54:15 2022] GET /identity/v3/projects/f89df535b56543e3b83b59bc617ffd14 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:15.218126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cbde3-1c59-4029-9c9b-2263199fe24f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:15.254100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:15.295481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3073dc3-b422-48d4-aa8f-48f23c78788f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:15.307482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:15.324142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cbde3-1c59-4029-9c9b-2263199fe24f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:15.328911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524dd79-0ab8-4491-aeae-043f01a39613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:15.329762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524dd79-0ab8-4491-aeae-043f01a39613 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:15.330039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524dd79-0ab8-4491-aeae-043f01a39613 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:15.330307 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524dd79-0ab8-4491-aeae-043f01a39613 None admin] PATH_INFO: `/v3/groups/8749fece5ea1456898d05aac2a1d72d9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:15.331855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524dd79-0ab8-4491-aeae-043f01a39613 None admin] RBAC: Authorizing `identity:get_group(group_id=8749fece5ea1456898d05aac2a1d72d9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:15.333274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524dd79-0ab8-4491-aeae-043f01a39613 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:15.334900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 220/452] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:15 2022] GET /identity/v3/groups/8749fece5ea1456898d05aac2a1d72d9 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:15.340756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524dd79-0ab8-4491-aeae-043f01a39613 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:15.359387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4deabb-e6fe-41de-b2e9-a3b70d9cd64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:15.360232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4deabb-e6fe-41de-b2e9-a3b70d9cd64f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:15.360510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4deabb-e6fe-41de-b2e9-a3b70d9cd64f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:15.360781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4deabb-e6fe-41de-b2e9-a3b70d9cd64f None admin] PATH_INFO: `/v3/groups/2acb4a44d6094655b2f6d635738bc3e4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:15.361943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4deabb-e6fe-41de-b2e9-a3b70d9cd64f None admin] RBAC: Authorizing `identity:get_group(group_id=2acb4a44d6094655b2f6d635738bc3e4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:15.363396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4deabb-e6fe-41de-b2e9-a3b70d9cd64f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:15.364996 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 233/453] 10.222.0.30 () {56 vars in 1180 bytes} [Mon May 23 17:54:15 2022] GET /identity/v3/groups/2acb4a44d6094655b2f6d635738bc3e4 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:15.371210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4deabb-e6fe-41de-b2e9-a3b70d9cd64f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:15.440149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524dd79-0ab8-4491-aeae-043f01a39613 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:15.467372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:15.468756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4deabb-e6fe-41de-b2e9-a3b70d9cd64f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:15.473350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e98eb-5cca-4a6b-8369-324752e65375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:15.473999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e98eb-5cca-4a6b-8369-324752e65375 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:15.474281 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e98eb-5cca-4a6b-8369-324752e65375 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:15.474556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e98eb-5cca-4a6b-8369-324752e65375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:15.475414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e98eb-5cca-4a6b-8369-324752e65375 None admin] RBAC: Adding query filter params (group.id=8749fece5ea1456898d05aac2a1d72d9, role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=883a3e766acb4bf0a201fc243774389f) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:15.475727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e98eb-5cca-4a6b-8369-324752e65375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:15.477160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e98eb-5cca-4a6b-8369-324752e65375 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:15.484402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 221/454] 10.222.0.30 () {56 vars in 1376 bytes} [Mon May 23 17:54:15 2022] GET /identity/v3/role_assignments?group.id=8749fece5ea1456898d05aac2a1d72d9&scope.project.id=883a3e766acb4bf0a201fc243774389f&role.id=af8084c48e3c40298e26d44d6d14595a => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:15.512071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c606c9f-6bb9-4b56-b5db-71f023f48428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:15.512744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606c9f-6bb9-4b56-b5db-71f023f48428 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:15.513024 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606c9f-6bb9-4b56-b5db-71f023f48428 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:15.513297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606c9f-6bb9-4b56-b5db-71f023f48428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:15.514145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c606c9f-6bb9-4b56-b5db-71f023f48428 None admin] RBAC: Adding query filter params (group.id=2acb4a44d6094655b2f6d635738bc3e4, role.id=66b09c60197a4a1fb2cca5402bb83375, scope.project.id=f89df535b56543e3b83b59bc617ffd14) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:15.514454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c606c9f-6bb9-4b56-b5db-71f023f48428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:15.515992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c606c9f-6bb9-4b56-b5db-71f023f48428 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:15.523099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 234/455] 10.222.0.30 () {56 vars in 1376 bytes} [Mon May 23 17:54:15 2022] GET /identity/v3/role_assignments?group.id=2acb4a44d6094655b2f6d635738bc3e4&scope.project.id=f89df535b56543e3b83b59bc617ffd14&role.id=66b09c60197a4a1fb2cca5402bb83375 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:18.245538 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475a4e-a83b-4f17-80b0-7ee58ab3ff4e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:18.246595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475a4e-a83b-4f17-80b0-7ee58ab3ff4e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:18.247127 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475a4e-a83b-4f17-80b0-7ee58ab3ff4e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:18.248977 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 222/456] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:18.254508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b78942-c759-40c7-8eb5-fe1c6acf6bdc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:18.255407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b78942-c759-40c7-8eb5-fe1c6acf6bdc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:18.255990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b78942-c759-40c7-8eb5-fe1c6acf6bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:18.279675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c6b78942-c759-40c7-8eb5-fe1c6acf6bdc None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:18.281302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c6b78942-c759-40c7-8eb5-fe1c6acf6bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:18.296266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:18.374185 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 235/457] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:18.421697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5475a4e-a83b-4f17-80b0-7ee58ab3ff4e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:18.565909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5475a4e-a83b-4f17-80b0-7ee58ab3ff4e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:18.607343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bb12e-2cec-464d-8944-21cd7453aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:18.608142 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bb12e-2cec-464d-8944-21cd7453aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:18.608421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bb12e-2cec-464d-8944-21cd7453aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:18.608692 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bb12e-2cec-464d-8944-21cd7453aeb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:18.630407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bb12e-2cec-464d-8944-21cd7453aeb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:18.631894 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bb12e-2cec-464d-8944-21cd7453aeb4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-763bb12e-2cec-464d-8944-21cd7453aeb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:18.654767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:18.655702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:18.656551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:18.656551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:18.656551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:18.656551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:18.660371 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 223/458] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:18.667805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b78942-c759-40c7-8eb5-fe1c6acf6bdc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:18.747859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc9d8d-d1b3-4a9f-8111-f7e1d5da65e1 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:18.748496 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc9d8d-d1b3-4a9f-8111-f7e1d5da65e1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:18.749434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc9d8d-d1b3-4a9f-8111-f7e1d5da65e1 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:18.751870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 224/459] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:18.757967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161c55b-3ce6-461b-bddf-c304cf066f69 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:18.758913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161c55b-3ce6-461b-bddf-c304cf066f69 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:18.759685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161c55b-3ce6-461b-bddf-c304cf066f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:18.789485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5161c55b-3ce6-461b-bddf-c304cf066f69 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:18.794255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5161c55b-3ce6-461b-bddf-c304cf066f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:18.859978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b78942-c759-40c7-8eb5-fe1c6acf6bdc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:18.883309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:18.925533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e262b6-f28d-4dc6-b0ff-a8b788297f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:18.926925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e262b6-f28d-4dc6-b0ff-a8b788297f44 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:18.927895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e262b6-f28d-4dc6-b0ff-a8b788297f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:18.929338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 225/460] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:18.929836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e262b6-f28d-4dc6-b0ff-a8b788297f44 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:18.930789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e262b6-f28d-4dc6-b0ff-a8b788297f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:18.931293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e262b6-f28d-4dc6-b0ff-a8b788297f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:18.932522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb27ce5-1dde-413e-9571-b8111128fce5 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:18.933045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb27ce5-1dde-413e-9571-b8111128fce5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:18.933347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb27ce5-1dde-413e-9571-b8111128fce5 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:18.933448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e262b6-f28d-4dc6-b0ff-a8b788297f44 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:18.934921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 226/461] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:18.939850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1b9cb-fb65-4174-8538-3317d25a3faf None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:18.940139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1b9cb-fb65-4174-8538-3317d25a3faf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:18.940421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1b9cb-fb65-4174-8538-3317d25a3faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:18.947247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 236/462] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:18.952696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e262b6-f28d-4dc6-b0ff-a8b788297f44 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:18.965660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c7e1b9cb-fb65-4174-8538-3317d25a3faf None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:18.967157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c7e1b9cb-fb65-4174-8538-3317d25a3faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:18.968326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:19.045867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 227/463] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:19.046624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1b9cb-fb65-4174-8538-3317d25a3faf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:19.070108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e262b6-f28d-4dc6-b0ff-a8b788297f44 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:19.107000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48816b-43ed-4b5a-80c3-050222afc47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:19.107665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48816b-43ed-4b5a-80c3-050222afc47f None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:19.107943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48816b-43ed-4b5a-80c3-050222afc47f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:19.108219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48816b-43ed-4b5a-80c3-050222afc47f None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:19.108972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48816b-43ed-4b5a-80c3-050222afc47f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:19.110342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48816b-43ed-4b5a-80c3-050222afc47f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:19.130967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 237/464] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:54:18 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:54:19.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa10b3d-717b-4884-a618-a9dcf46263e4 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:19.132843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa10b3d-717b-4884-a618-a9dcf46263e4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:19.133123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa10b3d-717b-4884-a618-a9dcf46263e4 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:19.134882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 238/465] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:19.140295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa10b3d-717b-4884-a618-a9dcf46263e4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:19.168831 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1b9cb-fb65-4174-8538-3317d25a3faf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:19.178688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:19.217051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab56c-596e-4424-99a4-1333b78d081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:19.218318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab56c-596e-4424-99a4-1333b78d081c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:19.218839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab56c-596e-4424-99a4-1333b78d081c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:19.219318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab56c-596e-4424-99a4-1333b78d081c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:19.232670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aab56c-596e-4424-99a4-1333b78d081c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:19.234575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aab56c-596e-4424-99a4-1333b78d081c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:19.235809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-87aab56c-596e-4424-99a4-1333b78d081c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:19.258999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:19.260279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:19.261712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:19.261712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:19.261712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:19.261712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:19.264334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 228/466] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:19.265990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892375a-78f1-4c9c-91b4-0cf05742a5fa None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:19.266530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892375a-78f1-4c9c-91b4-0cf05742a5fa None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:19.267035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892375a-78f1-4c9c-91b4-0cf05742a5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:19.288664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b892375a-78f1-4c9c-91b4-0cf05742a5fa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:19.290280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b892375a-78f1-4c9c-91b4-0cf05742a5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:19.297275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa10b3d-717b-4884-a618-a9dcf46263e4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:19.343237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294be393-4eb7-4d86-ba68-1d8326ae4d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:19.344028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294be393-4eb7-4d86-ba68-1d8326ae4d5f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:19.344311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294be393-4eb7-4d86-ba68-1d8326ae4d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:19.344585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294be393-4eb7-4d86-ba68-1d8326ae4d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:19.359220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294be393-4eb7-4d86-ba68-1d8326ae4d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:19.361042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294be393-4eb7-4d86-ba68-1d8326ae4d5f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:19.382726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 229/467] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:19.382726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892375a-78f1-4c9c-91b4-0cf05742a5fa None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-294be393-4eb7-4d86-ba68-1d8326ae4d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:19.384563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:19.385469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:19.386430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:19.386430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:19.386430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:19.386430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:19.388421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 239/468] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:19.394496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294be393-4eb7-4d86-ba68-1d8326ae4d5f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:19.510124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:19.530009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892375a-78f1-4c9c-91b4-0cf05742a5fa None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:19.532987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294be393-4eb7-4d86-ba68-1d8326ae4d5f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:19.552794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:19.575744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e360b-306a-4951-bb72-80d4c783f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:19.576415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e360b-306a-4951-bb72-80d4c783f312 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:19.576704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e360b-306a-4951-bb72-80d4c783f312 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:19.576983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e360b-306a-4951-bb72-80d4c783f312 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:19.577808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e360b-306a-4951-bb72-80d4c783f312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:19.578131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e360b-306a-4951-bb72-80d4c783f312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:19.579669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e360b-306a-4951-bb72-80d4c783f312 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:19.579784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098884b-8c2e-4dc4-ac51-52f9d1fa8901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:19.580591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098884b-8c2e-4dc4-ac51-52f9d1fa8901 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:19.581190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098884b-8c2e-4dc4-ac51-52f9d1fa8901 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:19.581622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098884b-8c2e-4dc4-ac51-52f9d1fa8901 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:19.582599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098884b-8c2e-4dc4-ac51-52f9d1fa8901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:19.583070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098884b-8c2e-4dc4-ac51-52f9d1fa8901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:19.584592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098884b-8c2e-4dc4-ac51-52f9d1fa8901 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:19.593845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 230/469] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:19.594621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e360b-306a-4951-bb72-80d4c783f312 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:19.603106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 240/470] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:19.604835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098884b-8c2e-4dc4-ac51-52f9d1fa8901 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:19.722005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098884b-8c2e-4dc4-ac51-52f9d1fa8901 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:19.743052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e360b-306a-4951-bb72-80d4c783f312 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:19.766132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d1ba1-de72-4cf6-9e72-b1dd8233035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:19.767301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d1ba1-de72-4cf6-9e72-b1dd8233035e None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:19.767592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d1ba1-de72-4cf6-9e72-b1dd8233035e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:19.767872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d1ba1-de72-4cf6-9e72-b1dd8233035e None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:19.768727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d1ba1-de72-4cf6-9e72-b1dd8233035e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:19.770604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d1ba1-de72-4cf6-9e72-b1dd8233035e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:19.782459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b31314-bfee-48bb-8ca8-1acdd0b6b928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:19.783699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b31314-bfee-48bb-8ca8-1acdd0b6b928 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:19.784183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b31314-bfee-48bb-8ca8-1acdd0b6b928 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:19.784815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b31314-bfee-48bb-8ca8-1acdd0b6b928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:19.797400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 241/471] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:54:19 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:54:19.798500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d1ba1-de72-4cf6-9e72-b1dd8233035e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:19.803212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b31314-bfee-48bb-8ca8-1acdd0b6b928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:19.809201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b31314-bfee-48bb-8ca8-1acdd0b6b928 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:19.830058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-80b31314-bfee-48bb-8ca8-1acdd0b6b928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:19.847187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:19.848134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:19.848974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:19.848974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:19.848974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:19.848974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:19.850036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 231/472] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:19.856601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b31314-bfee-48bb-8ca8-1acdd0b6b928 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:19.872525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:19.978780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d1ba1-de72-4cf6-9e72-b1dd8233035e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:19.993036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b31314-bfee-48bb-8ca8-1acdd0b6b928 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:20.018603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788ba56-8689-40df-a247-0cd4fa232c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:20.019312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788ba56-8689-40df-a247-0cd4fa232c08 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:20.019599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788ba56-8689-40df-a247-0cd4fa232c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:20.019880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788ba56-8689-40df-a247-0cd4fa232c08 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:20.020592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788ba56-8689-40df-a247-0cd4fa232c08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:20.022033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788ba56-8689-40df-a247-0cd4fa232c08 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:20.029280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300ba74-bfdf-4d59-b24d-363c47c64367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:20.029950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300ba74-bfdf-4d59-b24d-363c47c64367 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:20.030231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300ba74-bfdf-4d59-b24d-363c47c64367 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:20.030919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300ba74-bfdf-4d59-b24d-363c47c64367 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:20.031256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300ba74-bfdf-4d59-b24d-363c47c64367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:20.032182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300ba74-bfdf-4d59-b24d-363c47c64367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:20.033078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300ba74-bfdf-4d59-b24d-363c47c64367 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:20.048087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 242/473] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:54:19 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:54:20.053114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 232/474] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:20.054371 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300ba74-bfdf-4d59-b24d-363c47c64367 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:20.055032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775f90a-db89-4a64-9c14-7d70945d57a4 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:20.055531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775f90a-db89-4a64-9c14-7d70945d57a4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:20.056070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775f90a-db89-4a64-9c14-7d70945d57a4 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:20.057986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 243/475] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:20.064142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535dc18-5a3f-4f1e-89dc-7c05de543c2c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:20.064451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535dc18-5a3f-4f1e-89dc-7c05de543c2c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:20.064698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535dc18-5a3f-4f1e-89dc-7c05de543c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:20.091441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f535dc18-5a3f-4f1e-89dc-7c05de543c2c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:20.093161 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f535dc18-5a3f-4f1e-89dc-7c05de543c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:20.137242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:20.191681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 244/476] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:20.192979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300ba74-bfdf-4d59-b24d-363c47c64367 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:20.221054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535dc18-5a3f-4f1e-89dc-7c05de543c2c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:20.236333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979e44-988d-4fa4-9159-944dfa652904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:20.237020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979e44-988d-4fa4-9159-944dfa652904 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:20.238096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979e44-988d-4fa4-9159-944dfa652904 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:20.238379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979e44-988d-4fa4-9159-944dfa652904 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:20.239127 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3979e44-988d-4fa4-9159-944dfa652904 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:20.240653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3979e44-988d-4fa4-9159-944dfa652904 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:20.248713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:20.273389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 233/477] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:54:20 2022] POST /identity/v3/users => generated 249 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:54:20.357778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535dc18-5a3f-4f1e-89dc-7c05de543c2c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:20.395943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0a71f-aec3-4bee-bb2f-f3dc1a8f6681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:20.396622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0a71f-aec3-4bee-bb2f-f3dc1a8f6681 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:20.396901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0a71f-aec3-4bee-bb2f-f3dc1a8f6681 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:20.397179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0a71f-aec3-4bee-bb2f-f3dc1a8f6681 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:20.397932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0a71f-aec3-4bee-bb2f-f3dc1a8f6681 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:20.399354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0a71f-aec3-4bee-bb2f-f3dc1a8f6681 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:20.408911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.sql.core [None req-56b0a71f-aec3-4bee-bb2f-f3dc1a8f6681 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 17:54:20.408911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 17:54:20.408911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [parameters: {'id': '482bcd29dfa54b3c910d863afede77f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 17:54:20.408911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80381) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-56b0a71f-aec3-4bee-bb2f-f3dc1a8f6681 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application conn.query(q) May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result.read() May 23 17:54:20.426425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return ref.to_dict() May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:54:20.428186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application next(self.gen) May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application yield resource May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application next(self.gen) May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.session.rollback() May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.force_reraise() May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise self.value May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application session.commit() May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 17:54:20.429986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._prepare_impl() May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.session.flush() May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._flush(objects) May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application compat.raise_( May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application flush_context.execute() May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rec.execute(self) May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 17:54:20.433645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:54:20.436252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application conn.query(q) May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result.read() May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:54:20.438517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [parameters: {'id': '482bcd29dfa54b3c910d863afede77f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:20.444695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 17:54:20.447047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:20.449843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 245/478] 10.222.0.30 () {60 vars in 1131 bytes} [Mon May 23 17:54:20 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:20.449985 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979e44-988d-4fa4-9159-944dfa652904 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:20.553896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979e44-988d-4fa4-9159-944dfa652904 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:20.572273 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:20.591900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf0ee2-21ed-47ef-b665-954fee432b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:20.592727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0ee2-21ed-47ef-b665-954fee432b85 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:20.593017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0ee2-21ed-47ef-b665-954fee432b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:20.593275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0ee2-21ed-47ef-b665-954fee432b85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:20.604813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf0ee2-21ed-47ef-b665-954fee432b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-23cf0ee2-21ed-47ef-b665-954fee432b85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:20.613124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:20.613999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:20.614900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 234/479] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:54:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:20.620898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0a71f-aec3-4bee-bb2f-f3dc1a8f6681 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:20.709689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:20.731887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0a71f-aec3-4bee-bb2f-f3dc1a8f6681 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:20.772983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11beda-9f04-4f8d-9d86-9b6604943733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:20.773952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11beda-9f04-4f8d-9d86-9b6604943733 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:20.774381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11beda-9f04-4f8d-9d86-9b6604943733 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:20.774871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11beda-9f04-4f8d-9d86-9b6604943733 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:20.776230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11beda-9f04-4f8d-9d86-9b6604943733 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:20.776837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11beda-9f04-4f8d-9d86-9b6604943733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:20.778363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11beda-9f04-4f8d-9d86-9b6604943733 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:20.789017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 246/480] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:21.824255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205466-f597-428e-925d-a51efda9501b None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:21.824756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205466-f597-428e-925d-a51efda9501b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:21.824833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205466-f597-428e-925d-a51efda9501b None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:21.826604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 235/481] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:21.832365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa8b6b-a58c-4bdc-95d6-ff7634de2bfa None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:21.832776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa8b6b-a58c-4bdc-95d6-ff7634de2bfa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:21.832942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa8b6b-a58c-4bdc-95d6-ff7634de2bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:21.855213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bfaa8b6b-a58c-4bdc-95d6-ff7634de2bfa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:21.856413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bfaa8b6b-a58c-4bdc-95d6-ff7634de2bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:21.961000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 247/482] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:21.996844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205466-f597-428e-925d-a51efda9501b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:22.168037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205466-f597-428e-925d-a51efda9501b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:22.224777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95320498-e8fa-458c-bd04-59e35d75fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:22.225591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320498-e8fa-458c-bd04-59e35d75fa3c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:22.225878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320498-e8fa-458c-bd04-59e35d75fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:22.226154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320498-e8fa-458c-bd04-59e35d75fa3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:22.249515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95320498-e8fa-458c-bd04-59e35d75fa3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-95320498-e8fa-458c-bd04-59e35d75fa3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:22.257349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:22.258259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:22.259354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 236/483] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:22.265313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa8b6b-a58c-4bdc-95d6-ff7634de2bfa None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:22.395703 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:22.441580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa8b6b-a58c-4bdc-95d6-ff7634de2bfa None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:22.487910 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05373449-abce-4dbe-b2ed-d2e80ed0268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:22.488577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05373449-abce-4dbe-b2ed-d2e80ed0268a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:22.488854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05373449-abce-4dbe-b2ed-d2e80ed0268a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:22.489127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05373449-abce-4dbe-b2ed-d2e80ed0268a None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:22.489872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05373449-abce-4dbe-b2ed-d2e80ed0268a None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:22.490168 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05373449-abce-4dbe-b2ed-d2e80ed0268a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:22.491552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05373449-abce-4dbe-b2ed-d2e80ed0268a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:22.504397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 248/484] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:22.517643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95320498-e8fa-458c-bd04-59e35d75fa3c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:22.598302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:22.667466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95320498-e8fa-458c-bd04-59e35d75fa3c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:22.710245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80782a-467a-4fac-bd83-0188565e7428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:22.710996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80782a-467a-4fac-bd83-0188565e7428 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:22.711283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80782a-467a-4fac-bd83-0188565e7428 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:22.711559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80782a-467a-4fac-bd83-0188565e7428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:22.726991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80782a-467a-4fac-bd83-0188565e7428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:22.728483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80782a-467a-4fac-bd83-0188565e7428 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:22.731479 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec322f71-d79e-4669-80f6-f22db1ec79fb None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:22.731777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec322f71-d79e-4669-80f6-f22db1ec79fb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:22.732060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec322f71-d79e-4669-80f6-f22db1ec79fb None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:22.733753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 249/485] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:22.738594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6b39e-3a55-4ca8-a0ef-324619a6a0da None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:22.738922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6b39e-3a55-4ca8-a0ef-324619a6a0da None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:22.739208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6b39e-3a55-4ca8-a0ef-324619a6a0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-bc80782a-467a-4fac-bd83-0188565e7428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:22.751533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:22.752445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:22.753385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:22.753385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:22.753385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:22.753385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:22.753385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 237/486] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:22.761514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-68e6b39e-3a55-4ca8-a0ef-324619a6a0da None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:22.761751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80782a-467a-4fac-bd83-0188565e7428 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:22.762731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-68e6b39e-3a55-4ca8-a0ef-324619a6a0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:22.839112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 250/487] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:22.859834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6b39e-3a55-4ca8-a0ef-324619a6a0da None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:22.924193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:22.948922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80782a-467a-4fac-bd83-0188565e7428 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:22.963642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:23.026403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7bc5f-2fd9-493d-8542-5e9b1790bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:23.027124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7bc5f-2fd9-493d-8542-5e9b1790bc73 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.027411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7bc5f-2fd9-493d-8542-5e9b1790bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.027689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7bc5f-2fd9-493d-8542-5e9b1790bc73 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.028437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7bc5f-2fd9-493d-8542-5e9b1790bc73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:23.028747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7bc5f-2fd9-493d-8542-5e9b1790bc73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:23.030175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7bc5f-2fd9-493d-8542-5e9b1790bc73 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:23.046400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6b39e-3a55-4ca8-a0ef-324619a6a0da None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:23.061041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 238/488] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:23.069910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7bc5f-2fd9-493d-8542-5e9b1790bc73 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:23.098883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a3b60-7474-4482-8c7c-d7c78561c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:23.099686 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a3b60-7474-4482-8c7c-d7c78561c9de None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.099968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a3b60-7474-4482-8c7c-d7c78561c9de None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.100239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a3b60-7474-4482-8c7c-d7c78561c9de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.111721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a3b60-7474-4482-8c7c-d7c78561c9de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b57a3b60-7474-4482-8c7c-d7c78561c9de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:23.119544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:23.120492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:23.121305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 251/489] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:23.122328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cd0ba-0bb2-4673-b1e1-4217495eddf1 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.126874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cd0ba-0bb2-4673-b1e1-4217495eddf1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.126874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cd0ba-0bb2-4673-b1e1-4217495eddf1 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.128316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 252/490] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:23.129441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a5e4-e6aa-4ba9-9863-31dcb736128a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.129725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a5e4-e6aa-4ba9-9863-31dcb736128a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.130000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a5e4-e6aa-4ba9-9863-31dcb736128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.147215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c831a5e4-e6aa-4ba9-9863-31dcb736128a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:23.148392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c831a5e4-e6aa-4ba9-9863-31dcb736128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:23.197892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7bc5f-2fd9-493d-8542-5e9b1790bc73 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:23.226932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 253/491] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:23.227819 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a5e4-e6aa-4ba9-9863-31dcb736128a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:23.235161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff867e-9543-418b-bc64-8e3bdd5b6ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:23.236079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff867e-9543-418b-bc64-8e3bdd5b6ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.236433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff867e-9543-418b-bc64-8e3bdd5b6ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.236781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff867e-9543-418b-bc64-8e3bdd5b6ce6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.246818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff867e-9543-418b-bc64-8e3bdd5b6ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:23.248606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff867e-9543-418b-bc64-8e3bdd5b6ce6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-6bff867e-9543-418b-bc64-8e3bdd5b6ce6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:23.265556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:23.266515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:23.268051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 239/492] 10.222.0.30 () {56 vars in 1093 bytes} [Mon May 23 17:54:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:23.268612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3beae08-9d51-49d6-8d6f-a0f6293437e7 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.268865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3beae08-9d51-49d6-8d6f-a0f6293437e7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.268953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3beae08-9d51-49d6-8d6f-a0f6293437e7 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.274721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 240/493] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:23.274721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3beae08-9d51-49d6-8d6f-a0f6293437e7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:23.285152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:23.292130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:23.342099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a5e4-e6aa-4ba9-9863-31dcb736128a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:23.380302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cded2ad-1a1c-4c56-bccc-e119fa8e74c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:23.381289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded2ad-1a1c-4c56-bccc-e119fa8e74c4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.381746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded2ad-1a1c-4c56-bccc-e119fa8e74c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.381849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3beae08-9d51-49d6-8d6f-a0f6293437e7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:23.382283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded2ad-1a1c-4c56-bccc-e119fa8e74c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.383359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cded2ad-1a1c-4c56-bccc-e119fa8e74c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:23.384206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cded2ad-1a1c-4c56-bccc-e119fa8e74c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:23.385892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cded2ad-1a1c-4c56-bccc-e119fa8e74c4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:23.399076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 254/494] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:23.400132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cded2ad-1a1c-4c56-bccc-e119fa8e74c4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:23.417350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df598db4-557c-4f3b-8b6b-34f4fdb3193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:23.418147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df598db4-557c-4f3b-8b6b-34f4fdb3193d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.418429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df598db4-557c-4f3b-8b6b-34f4fdb3193d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.418729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df598db4-557c-4f3b-8b6b-34f4fdb3193d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.428753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df598db4-557c-4f3b-8b6b-34f4fdb3193d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-df598db4-557c-4f3b-8b6b-34f4fdb3193d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:23.436540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:23.437635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:23.438626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:23.442462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 241/495] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:23.443742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24c672-609a-43b3-be4a-12cd867165ec None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.444027 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24c672-609a-43b3-be4a-12cd867165ec None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.444300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24c672-609a-43b3-be4a-12cd867165ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.460839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7d24c672-609a-43b3-be4a-12cd867165ec None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:23.462009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7d24c672-609a-43b3-be4a-12cd867165ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:23.516353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cded2ad-1a1c-4c56-bccc-e119fa8e74c4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:23.533856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:23.541111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:23.542060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 242/496] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:23.543453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24c672-609a-43b3-be4a-12cd867165ec None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:23.569463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8378ee4-f447-43e0-abca-e1faaee39a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:23.570232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8378ee4-f447-43e0-abca-e1faaee39a6c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.570585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8378ee4-f447-43e0-abca-e1faaee39a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.570957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8378ee4-f447-43e0-abca-e1faaee39a6c None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.571926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8378ee4-f447-43e0-abca-e1faaee39a6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:23.572244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8378ee4-f447-43e0-abca-e1faaee39a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:23.573729 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8378ee4-f447-43e0-abca-e1faaee39a6c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:23.616318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 255/497] 10.222.0.30 () {56 vars in 1133 bytes} [Mon May 23 17:54:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:23.616318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8378ee4-f447-43e0-abca-e1faaee39a6c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:23.655665 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24c672-609a-43b3-be4a-12cd867165ec None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:23.689282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfb0e4-3d24-4f99-92ac-e65b0c0e9c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:23.690072 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfb0e4-3d24-4f99-92ac-e65b0c0e9c3a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.690351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfb0e4-3d24-4f99-92ac-e65b0c0e9c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.690615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfb0e4-3d24-4f99-92ac-e65b0c0e9c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.702010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfb0e4-3d24-4f99-92ac-e65b0c0e9c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:23.703497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfb0e4-3d24-4f99-92ac-e65b0c0e9c3a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:23.719245 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8378ee4-f447-43e0-abca-e1faaee39a6c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-cebfb0e4-3d24-4f99-92ac-e65b0c0e9c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:23.721702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:23.722674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:23.723599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:23.723599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:23.723599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:23.723599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:23.723599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 243/498] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:23.723864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfb0e4-3d24-4f99-92ac-e65b0c0e9c3a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:23.753518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c78a-de57-4861-875e-580f26bb9a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:23.754180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c78a-de57-4861-875e-580f26bb9a5f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.754461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c78a-de57-4861-875e-580f26bb9a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.754762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c78a-de57-4861-875e-580f26bb9a5f None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.755504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c78a-de57-4861-875e-580f26bb9a5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:23.755807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c78a-de57-4861-875e-580f26bb9a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:23.757180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c78a-de57-4861-875e-580f26bb9a5f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:23.768114 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 256/499] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:23.769157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c78a-de57-4861-875e-580f26bb9a5f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:23.779337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:23.805795 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:23.828372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfb0e4-3d24-4f99-92ac-e65b0c0e9c3a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:23.862719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90ced9-10dd-4777-bfab-923f9e9774fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:23.863522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90ced9-10dd-4777-bfab-923f9e9774fb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.863803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90ced9-10dd-4777-bfab-923f9e9774fb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.864072 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90ced9-10dd-4777-bfab-923f9e9774fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.869323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c78a-de57-4861-875e-580f26bb9a5f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:23.874576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90ced9-10dd-4777-bfab-923f9e9774fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-bb90ced9-10dd-4777-bfab-923f9e9774fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:23.882137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:23.883321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:23.884752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 244/500] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:23.885484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c404b-7514-4425-b701-2ae2e5d81206 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.885484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c404b-7514-4425-b701-2ae2e5d81206 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.885694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c404b-7514-4425-b701-2ae2e5d81206 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.886954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 245/501] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:23.887636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c404b-7514-4425-b701-2ae2e5d81206 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:23.909050 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc752ff4-d616-4a8b-97ea-326f61f6d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:23.909689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc752ff4-d616-4a8b-97ea-326f61f6d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:23.909970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc752ff4-d616-4a8b-97ea-326f61f6d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:23.910243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc752ff4-d616-4a8b-97ea-326f61f6d5e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:23.975766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc752ff4-d616-4a8b-97ea-326f61f6d5e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:23.977214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc752ff4-d616-4a8b-97ea-326f61f6d5e3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:23.987080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c404b-7514-4425-b701-2ae2e5d81206 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:23.997677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:24.012921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:24.022299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce67aac-a7c0-4b51-b3f8-eada6674c275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:24.022922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67aac-a7c0-4b51-b3f8-eada6674c275 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.023207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67aac-a7c0-4b51-b3f8-eada6674c275 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.023477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67aac-a7c0-4b51-b3f8-eada6674c275 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.024178 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce67aac-a7c0-4b51-b3f8-eada6674c275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:24.024478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce67aac-a7c0-4b51-b3f8-eada6674c275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:24.025869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce67aac-a7c0-4b51-b3f8-eada6674c275 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:24.037542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 246/502] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:24.038315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce67aac-a7c0-4b51-b3f8-eada6674c275 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.078630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 257/503] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:24.079498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc752ff4-d616-4a8b-97ea-326f61f6d5e3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.139789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce67aac-a7c0-4b51-b3f8-eada6674c275 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:24.173348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c323ec-68af-490c-81d0-3a8f3e75e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:24.174387 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c323ec-68af-490c-81d0-3a8f3e75e6bb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.174671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c323ec-68af-490c-81d0-3a8f3e75e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.174970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c323ec-68af-490c-81d0-3a8f3e75e6bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.176434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc752ff4-d616-4a8b-97ea-326f61f6d5e3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:24.185515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c323ec-68af-490c-81d0-3a8f3e75e6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:24.186992 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c323ec-68af-490c-81d0-3a8f3e75e6bb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-90c323ec-68af-490c-81d0-3a8f3e75e6bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:24.204669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:24.205526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:24.206380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:24.206380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:24.206380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:24.206380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:24.206380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 247/504] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:24.207168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7528fd8-243d-4833-bed4-144eb3406785 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.207458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7528fd8-243d-4833-bed4-144eb3406785 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.207738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7528fd8-243d-4833-bed4-144eb3406785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.214200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235c9d3-b187-4893-b332-6d4fa9c4051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:24.214893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235c9d3-b187-4893-b332-6d4fa9c4051d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.215176 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235c9d3-b187-4893-b332-6d4fa9c4051d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.215447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235c9d3-b187-4893-b332-6d4fa9c4051d None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.216186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235c9d3-b187-4893-b332-6d4fa9c4051d None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:24.216489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235c9d3-b187-4893-b332-6d4fa9c4051d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:24.217853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235c9d3-b187-4893-b332-6d4fa9c4051d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:24.220604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:24.224030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a7528fd8-243d-4833-bed4-144eb3406785 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:24.225231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a7528fd8-243d-4833-bed4-144eb3406785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:24.227339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 258/505] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:24.228124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235c9d3-b187-4893-b332-6d4fa9c4051d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.245747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:24.295794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 248/506] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:24.296550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7528fd8-243d-4833-bed4-144eb3406785 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.330348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235c9d3-b187-4893-b332-6d4fa9c4051d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:24.363644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76440be1-448c-475c-9a2c-b13e9d8c239b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:24.364429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76440be1-448c-475c-9a2c-b13e9d8c239b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.364713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76440be1-448c-475c-9a2c-b13e9d8c239b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.364986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76440be1-448c-475c-9a2c-b13e9d8c239b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.372545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76440be1-448c-475c-9a2c-b13e9d8c239b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:24.373971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76440be1-448c-475c-9a2c-b13e9d8c239b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-76440be1-448c-475c-9a2c-b13e9d8c239b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:24.389951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:24.390946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:24.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:24.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:24.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:24.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:24.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:24.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:24.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:24.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:24.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:54:24.391854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:24.394887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 259/507] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:24.396688 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76440be1-448c-475c-9a2c-b13e9d8c239b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.402075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7528fd8-243d-4833-bed4-144eb3406785 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:24.436201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77eafe-a833-40f0-8ad2-fc549fd1005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:24.437089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77eafe-a833-40f0-8ad2-fc549fd1005c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.437444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77eafe-a833-40f0-8ad2-fc549fd1005c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.437810 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77eafe-a833-40f0-8ad2-fc549fd1005c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.449528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77eafe-a833-40f0-8ad2-fc549fd1005c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:24.451057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77eafe-a833-40f0-8ad2-fc549fd1005c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:24.468333 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-fe77eafe-a833-40f0-8ad2-fc549fd1005c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:24.470056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:24.471351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:24.472281 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:24.472281 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:24.472281 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:24.472281 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:24.472281 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 249/508] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:24.472902 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77eafe-a833-40f0-8ad2-fc549fd1005c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.477186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:24.529431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76440be1-448c-475c-9a2c-b13e9d8c239b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:24.568008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410f05-fb24-4b0e-ad29-b9627419a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:24.569150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410f05-fb24-4b0e-ad29-b9627419a61e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.569718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410f05-fb24-4b0e-ad29-b9627419a61e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.570236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410f05-fb24-4b0e-ad29-b9627419a61e None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.571583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55410f05-fb24-4b0e-ad29-b9627419a61e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:24.572100 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55410f05-fb24-4b0e-ad29-b9627419a61e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:24.574888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55410f05-fb24-4b0e-ad29-b9627419a61e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:24.588340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 260/509] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:24.589674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410f05-fb24-4b0e-ad29-b9627419a61e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.602517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77eafe-a833-40f0-8ad2-fc549fd1005c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:24.642055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe05e7-687a-49f0-8f8c-4be383842334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:24.643230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe05e7-687a-49f0-8f8c-4be383842334 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.643505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe05e7-687a-49f0-8f8c-4be383842334 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.644093 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe05e7-687a-49f0-8f8c-4be383842334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.655159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe05e7-687a-49f0-8f8c-4be383842334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:24.656699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe05e7-687a-49f0-8f8c-4be383842334 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b2fe05e7-687a-49f0-8f8c-4be383842334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:24.676205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:24.677070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:24.677927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:24.677927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:24.677927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:24.677927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:24.677927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 250/510] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:24.678187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe05e7-687a-49f0-8f8c-4be383842334 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.709522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410f05-fb24-4b0e-ad29-b9627419a61e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:24.726932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:24.737846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:24.744567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1cc5f-2531-4103-ac57-a6527faa68ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:24.745359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1cc5f-2531-4103-ac57-a6527faa68ca None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.745644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1cc5f-2531-4103-ac57-a6527faa68ca None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.745953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1cc5f-2531-4103-ac57-a6527faa68ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.755950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1cc5f-2531-4103-ac57-a6527faa68ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:24.757403 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1cc5f-2531-4103-ac57-a6527faa68ca None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-82d1cc5f-2531-4103-ac57-a6527faa68ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:24.774981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:24.776544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:24.777492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:24.777492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:24.777492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:24.777492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:24.777492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 261/511] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:24.777760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1cc5f-2531-4103-ac57-a6527faa68ca None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.786277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe05e7-687a-49f0-8f8c-4be383842334 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:24.822088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38b8cd-3801-4d64-b655-51bb6d0fa5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:24.823253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38b8cd-3801-4d64-b655-51bb6d0fa5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.823544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38b8cd-3801-4d64-b655-51bb6d0fa5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.823828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38b8cd-3801-4d64-b655-51bb6d0fa5c5 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.824656 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38b8cd-3801-4d64-b655-51bb6d0fa5c5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:24.824965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38b8cd-3801-4d64-b655-51bb6d0fa5c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:24.826412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38b8cd-3801-4d64-b655-51bb6d0fa5c5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:24.862137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 251/512] 10.222.0.30 () {56 vars in 1137 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:24.863070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38b8cd-3801-4d64-b655-51bb6d0fa5c5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.878384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1cc5f-2531-4103-ac57-a6527faa68ca None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:24.913043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf4d7-4537-4854-abfa-09256d2cd416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:24.913698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf4d7-4537-4854-abfa-09256d2cd416 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:24.913984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf4d7-4537-4854-abfa-09256d2cd416 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:24.914264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bf4d7-4537-4854-abfa-09256d2cd416 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:24.915015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bf4d7-4537-4854-abfa-09256d2cd416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:24.915326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bf4d7-4537-4854-abfa-09256d2cd416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:24.916809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bf4d7-4537-4854-abfa-09256d2cd416 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:24.928139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 262/513] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:24.928959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf4d7-4537-4854-abfa-09256d2cd416 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:24.959849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:24.967657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38b8cd-3801-4d64-b655-51bb6d0fa5c5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:24.981915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:25.003004 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4104ba-2deb-4686-8e44-b21dd329c885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.003803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4104ba-2deb-4686-8e44-b21dd329c885 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.004090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4104ba-2deb-4686-8e44-b21dd329c885 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.004369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4104ba-2deb-4686-8e44-b21dd329c885 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.011735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4104ba-2deb-4686-8e44-b21dd329c885 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.013215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4104ba-2deb-4686-8e44-b21dd329c885 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-6d4104ba-2deb-4686-8e44-b21dd329c885 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:25.027828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:25.028886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:25.029759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:25.029759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:25.029759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:25.029759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:25.029759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:25.029759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:25.029759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:25.029759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:25.029759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 17:54:25.029759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:25.030432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bf4d7-4537-4854-abfa-09256d2cd416 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.030516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 252/514] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:25.030516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4104ba-2deb-4686-8e44-b21dd329c885 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:25.064162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e362-a758-42b4-9b6e-33bb11472a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.064811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e362-a758-42b4-9b6e-33bb11472a85 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.065092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e362-a758-42b4-9b6e-33bb11472a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.065363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e362-a758-42b4-9b6e-33bb11472a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.066076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636e362-a758-42b4-9b6e-33bb11472a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:25.066380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636e362-a758-42b4-9b6e-33bb11472a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.067773 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636e362-a758-42b4-9b6e-33bb11472a85 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:25.079380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 263/515] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:25.080183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e362-a758-42b4-9b6e-33bb11472a85 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:25.132700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4104ba-2deb-4686-8e44-b21dd329c885 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.167329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525994af-ce05-4f96-aab0-1791f7e2c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.167982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525994af-ce05-4f96-aab0-1791f7e2c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.168268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525994af-ce05-4f96-aab0-1791f7e2c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.168546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525994af-ce05-4f96-aab0-1791f7e2c2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.169259 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:25.169373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525994af-ce05-4f96-aab0-1791f7e2c2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:25.169572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525994af-ce05-4f96-aab0-1791f7e2c2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.171393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525994af-ce05-4f96-aab0-1791f7e2c2e6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:25.179361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e362-a758-42b4-9b6e-33bb11472a85 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.182899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 253/516] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:25.183683 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525994af-ce05-4f96-aab0-1791f7e2c2e6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:25.215321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b1ee-6da3-4266-8fca-917c123f265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.215967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b1ee-6da3-4266-8fca-917c123f265c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.216249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b1ee-6da3-4266-8fca-917c123f265c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.216528 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b1ee-6da3-4266-8fca-917c123f265c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.219542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:25.283348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b1ee-6da3-4266-8fca-917c123f265c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.284754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525994af-ce05-4f96-aab0-1791f7e2c2e6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.284875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b1ee-6da3-4266-8fca-917c123f265c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:25.318840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3617a4-3bbb-48ef-a0a2-fca7d13078c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.319630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3617a4-3bbb-48ef-a0a2-fca7d13078c7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.319914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3617a4-3bbb-48ef-a0a2-fca7d13078c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.320189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3617a4-3bbb-48ef-a0a2-fca7d13078c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.327774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3617a4-3bbb-48ef-a0a2-fca7d13078c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.329219 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3617a4-3bbb-48ef-a0a2-fca7d13078c7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-6f3617a4-3bbb-48ef-a0a2-fca7d13078c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:25.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:25.345504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:25.346477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:25.346477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:25.346477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:25.346477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:25.346477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:25.346477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:25.346477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:25.346477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:25.346477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 254/517] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:25.346477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3617a4-3bbb-48ef-a0a2-fca7d13078c7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:25.380622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:25.392436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 264/518] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:25.393250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b1ee-6da3-4266-8fca-917c123f265c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:25.437862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:25.445250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3617a4-3bbb-48ef-a0a2-fca7d13078c7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.480197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461959c-2cf6-4b99-b5a8-04ee9b691f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.480858 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461959c-2cf6-4b99-b5a8-04ee9b691f7d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.481143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461959c-2cf6-4b99-b5a8-04ee9b691f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.481418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461959c-2cf6-4b99-b5a8-04ee9b691f7d None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.482249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461959c-2cf6-4b99-b5a8-04ee9b691f7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:25.482556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461959c-2cf6-4b99-b5a8-04ee9b691f7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.484044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461959c-2cf6-4b99-b5a8-04ee9b691f7d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:25.491070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b1ee-6da3-4266-8fca-917c123f265c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.501986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 255/519] 10.222.0.30 () {56 vars in 1137 bytes} [Mon May 23 17:54:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:25.502678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461959c-2cf6-4b99-b5a8-04ee9b691f7d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:25.527424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf535d4-5cad-441a-ada7-b5aac5c04d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.528219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf535d4-5cad-441a-ada7-b5aac5c04d03 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.528499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf535d4-5cad-441a-ada7-b5aac5c04d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.528772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf535d4-5cad-441a-ada7-b5aac5c04d03 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.536190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf535d4-5cad-441a-ada7-b5aac5c04d03 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.537631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf535d4-5cad-441a-ada7-b5aac5c04d03 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-8bf535d4-5cad-441a-ada7-b5aac5c04d03 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:25.553005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:25.553879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:25.554798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 265/520] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:25.555373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf535d4-5cad-441a-ada7-b5aac5c04d03 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:25.601616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461959c-2cf6-4b99-b5a8-04ee9b691f7d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.608022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:25.637486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdec66-53a2-4959-9c0d-5af262c0b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.638153 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdec66-53a2-4959-9c0d-5af262c0b1f9 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.638437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdec66-53a2-4959-9c0d-5af262c0b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.638727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdec66-53a2-4959-9c0d-5af262c0b1f9 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.639430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdec66-53a2-4959-9c0d-5af262c0b1f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.640853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdec66-53a2-4959-9c0d-5af262c0b1f9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:25.659822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 256/521] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:54:25 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:54:25.660448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdec66-53a2-4959-9c0d-5af262c0b1f9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:25.660682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf535d4-5cad-441a-ada7-b5aac5c04d03 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.672069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:25.703483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15355c75-166f-4ca4-9bfa-d9d167db44b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.704156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15355c75-166f-4ca4-9bfa-d9d167db44b6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.704438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15355c75-166f-4ca4-9bfa-d9d167db44b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.704715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15355c75-166f-4ca4-9bfa-d9d167db44b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.705518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15355c75-166f-4ca4-9bfa-d9d167db44b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:25.705826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15355c75-166f-4ca4-9bfa-d9d167db44b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.707650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15355c75-166f-4ca4-9bfa-d9d167db44b6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:25.728547 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 266/522] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:25.738149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15355c75-166f-4ca4-9bfa-d9d167db44b6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:25.780655 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdec66-53a2-4959-9c0d-5af262c0b1f9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.820547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c9df1-f350-404a-9e1f-513be4f4d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.821359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9df1-f350-404a-9e1f-513be4f4d14f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.821662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9df1-f350-404a-9e1f-513be4f4d14f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.821915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9df1-f350-404a-9e1f-513be4f4d14f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.834247 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c9df1-f350-404a-9e1f-513be4f4d14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.835780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c9df1-f350-404a-9e1f-513be4f4d14f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-2c6c9df1-f350-404a-9e1f-513be4f4d14f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:25.854320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:25.855356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:25.856189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:25.856189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:25.856189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:25.856189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:25.856415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15355c75-166f-4ca4-9bfa-d9d167db44b6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.860151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 257/523] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:25.860748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c9df1-f350-404a-9e1f-513be4f4d14f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:25.869043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:25.900389 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3466b5-28e9-4397-865f-8803dd39f394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:25.901349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3466b5-28e9-4397-865f-8803dd39f394 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:25.901695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3466b5-28e9-4397-865f-8803dd39f394 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:25.902043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3466b5-28e9-4397-865f-8803dd39f394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:25.932838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:25.975144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c9df1-f350-404a-9e1f-513be4f4d14f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:25.976309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3466b5-28e9-4397-865f-8803dd39f394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:25.978093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3466b5-28e9-4397-865f-8803dd39f394 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:26.011688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda992e-28ce-409b-aa9b-d929c4502d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:26.012376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda992e-28ce-409b-aa9b-d929c4502d22 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:26.012665 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda992e-28ce-409b-aa9b-d929c4502d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:26.012948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda992e-28ce-409b-aa9b-d929c4502d22 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:26.013786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda992e-28ce-409b-aa9b-d929c4502d22 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:26.014100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda992e-28ce-409b-aa9b-d929c4502d22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:26.015581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda992e-28ce-409b-aa9b-d929c4502d22 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:26.032760 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 258/524] 10.222.0.30 () {56 vars in 1139 bytes} [Mon May 23 17:54:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:26.033597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda992e-28ce-409b-aa9b-d929c4502d22 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:26.094536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 267/525] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:26.095680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3466b5-28e9-4397-865f-8803dd39f394 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:26.107310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:26.144044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda992e-28ce-409b-aa9b-d929c4502d22 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:26.163581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:26.190505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f026a55-854f-4070-a1c9-d8f5348c191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:26.191211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f026a55-854f-4070-a1c9-d8f5348c191b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:26.191499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f026a55-854f-4070-a1c9-d8f5348c191b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:26.191777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f026a55-854f-4070-a1c9-d8f5348c191b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:26.192607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f026a55-854f-4070-a1c9-d8f5348c191b None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=9021e2249e11489083139e210562ce44) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:26.192923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f026a55-854f-4070-a1c9-d8f5348c191b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:26.194357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f026a55-854f-4070-a1c9-d8f5348c191b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:26.210744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 259/526] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:26 2022] GET /identity/v3/role_assignments?user.id=9021e2249e11489083139e210562ce44&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:26.210744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f026a55-854f-4070-a1c9-d8f5348c191b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:26.220835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3466b5-28e9-4397-865f-8803dd39f394 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:26.262545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0228-ff94-406d-a17e-fa818271a8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:26.263423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0228-ff94-406d-a17e-fa818271a8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:26.263808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0228-ff94-406d-a17e-fa818271a8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:26.264193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0228-ff94-406d-a17e-fa818271a8f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:26.265052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc0228-ff94-406d-a17e-fa818271a8f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:26.265468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc0228-ff94-406d-a17e-fa818271a8f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:26.267170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc0228-ff94-406d-a17e-fa818271a8f1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:26.286482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 268/527] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:26.287894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0228-ff94-406d-a17e-fa818271a8f1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:26.352239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f026a55-854f-4070-a1c9-d8f5348c191b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:26.374208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:26.402557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c09b1-10f8-49d5-8ef8-3126f8f42055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:26.403676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c09b1-10f8-49d5-8ef8-3126f8f42055 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:26.404147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c09b1-10f8-49d5-8ef8-3126f8f42055 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:26.404562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c09b1-10f8-49d5-8ef8-3126f8f42055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:26.414783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0228-ff94-406d-a17e-fa818271a8f1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:26.461903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19589cc5-7bc0-4e93-b43c-851149df3b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:26.462691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19589cc5-7bc0-4e93-b43c-851149df3b3d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:26.462999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19589cc5-7bc0-4e93-b43c-851149df3b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:26.463318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19589cc5-7bc0-4e93-b43c-851149df3b3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:26.476980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:26.477554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19589cc5-7bc0-4e93-b43c-851149df3b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:26.480055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19589cc5-7bc0-4e93-b43c-851149df3b3d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:26.499889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c09b1-10f8-49d5-8ef8-3126f8f42055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:26.501406 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c09b1-10f8-49d5-8ef8-3126f8f42055 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-19589cc5-7bc0-4e93-b43c-851149df3b3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:26.506069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:26.507121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:26.508063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:26.508063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:26.508063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:26.508063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:26.511888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 269/528] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:26.516501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19589cc5-7bc0-4e93-b43c-851149df3b3d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:26.616557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 260/529] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:26.617470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c09b1-10f8-49d5-8ef8-3126f8f42055 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:26.654927 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19589cc5-7bc0-4e93-b43c-851149df3b3d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:26.686148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:26.702579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:26.705082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed08189-f6ef-4a46-9179-d42df7d07622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:26.706378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed08189-f6ef-4a46-9179-d42df7d07622 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:26.707521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed08189-f6ef-4a46-9179-d42df7d07622 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:26.708004 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed08189-f6ef-4a46-9179-d42df7d07622 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:26.718223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed08189-f6ef-4a46-9179-d42df7d07622 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:26.720401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed08189-f6ef-4a46-9179-d42df7d07622 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:26.723834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c09b1-10f8-49d5-8ef8-3126f8f42055 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5ed08189-f6ef-4a46-9179-d42df7d07622 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:26.742448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:26.743565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:26.744755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:26.744755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:26.744755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:26.744755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:26.744755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:26.744755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:26.744755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:26.744755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:26.747769 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 270/530] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:26.748810 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed08189-f6ef-4a46-9179-d42df7d07622 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:26.773725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c60983-ebef-4416-8a4b-5d87747f5827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:26.774535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c60983-ebef-4416-8a4b-5d87747f5827 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:26.775385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c60983-ebef-4416-8a4b-5d87747f5827 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:26.775839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c60983-ebef-4416-8a4b-5d87747f5827 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:26.777108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c60983-ebef-4416-8a4b-5d87747f5827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:26.777522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c60983-ebef-4416-8a4b-5d87747f5827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:26.779592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c60983-ebef-4416-8a4b-5d87747f5827 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:26.795909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 261/531] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:26.796764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c60983-ebef-4416-8a4b-5d87747f5827 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:26.863485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed08189-f6ef-4a46-9179-d42df7d07622 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:26.902666 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f356e4-7a2d-4bf5-b4e0-003f62110ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:26.903487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f356e4-7a2d-4bf5-b4e0-003f62110ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:26.903771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f356e4-7a2d-4bf5-b4e0-003f62110ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:26.904046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f356e4-7a2d-4bf5-b4e0-003f62110ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:26.917947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f356e4-7a2d-4bf5-b4e0-003f62110ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:26.919579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f356e4-7a2d-4bf5-b4e0-003f62110ac1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:26.934650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c60983-ebef-4416-8a4b-5d87747f5827 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-08f356e4-7a2d-4bf5-b4e0-003f62110ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:26.938578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:26.939454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:26.940311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:26.940311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:26.940311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:26.940311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:26.944374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 271/532] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:26.945377 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f356e4-7a2d-4bf5-b4e0-003f62110ac1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:26.981044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b435f-75a2-48a5-a80b-d26bf0590264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:26.982586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b435f-75a2-48a5-a80b-d26bf0590264 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:26.983411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b435f-75a2-48a5-a80b-d26bf0590264 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:26.983906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b435f-75a2-48a5-a80b-d26bf0590264 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:26.985149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b435f-75a2-48a5-a80b-d26bf0590264 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:26.985663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b435f-75a2-48a5-a80b-d26bf0590264 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:26.987995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b435f-75a2-48a5-a80b-d26bf0590264 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:26.992525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:27.018208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 262/533] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:27.019733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b435f-75a2-48a5-a80b-d26bf0590264 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:27.022603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:27.071538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f356e4-7a2d-4bf5-b4e0-003f62110ac1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:27.109588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bd327-3f87-4f8a-a266-88c6f90e236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:27.110407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bd327-3f87-4f8a-a266-88c6f90e236f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:27.110767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bd327-3f87-4f8a-a266-88c6f90e236f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:27.111053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bd327-3f87-4f8a-a266-88c6f90e236f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:27.118030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bd327-3f87-4f8a-a266-88c6f90e236f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:27.121261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bd327-3f87-4f8a-a266-88c6f90e236f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-640bd327-3f87-4f8a-a266-88c6f90e236f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:27.135872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:27.136897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:27.137932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:27.137932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:27.137932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:27.137932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:27.137932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:27.137932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:27.137932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:27.137932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:27.144292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 272/534] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:27.145206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bd327-3f87-4f8a-a266-88c6f90e236f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:27.158990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b435f-75a2-48a5-a80b-d26bf0590264 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:27.201402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f14eb-3ee2-4c5e-ace7-22efd1ce329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:27.202144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f14eb-3ee2-4c5e-ace7-22efd1ce329b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:27.202533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f14eb-3ee2-4c5e-ace7-22efd1ce329b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:27.203132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f14eb-3ee2-4c5e-ace7-22efd1ce329b None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:27.203775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f14eb-3ee2-4c5e-ace7-22efd1ce329b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:27.204239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f14eb-3ee2-4c5e-ace7-22efd1ce329b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:27.205873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f14eb-3ee2-4c5e-ace7-22efd1ce329b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:27.223166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 263/535] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:27.224133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f14eb-3ee2-4c5e-ace7-22efd1ce329b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:27.261763 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:27.271331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bd327-3f87-4f8a-a266-88c6f90e236f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:27.294632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:27.317270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1408ed-e50f-4377-a1cc-5802eddb7590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:27.318559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1408ed-e50f-4377-a1cc-5802eddb7590 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:27.319280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1408ed-e50f-4377-a1cc-5802eddb7590 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:27.319713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1408ed-e50f-4377-a1cc-5802eddb7590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:27.320845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1408ed-e50f-4377-a1cc-5802eddb7590 None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=e8eae73572d54dcaac9f3f6bb24df316) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:27.321330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1408ed-e50f-4377-a1cc-5802eddb7590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:27.323999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1408ed-e50f-4377-a1cc-5802eddb7590 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:27.331753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 273/536] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:27 2022] GET /identity/v3/role_assignments?user.id=e8eae73572d54dcaac9f3f6bb24df316&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:27.332720 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1408ed-e50f-4377-a1cc-5802eddb7590 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:27.350976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f14eb-3ee2-4c5e-ace7-22efd1ce329b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:27.460102 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617ec8d-b15e-40e6-9d12-b684c1a760d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:27.460864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617ec8d-b15e-40e6-9d12-b684c1a760d3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:27.461241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617ec8d-b15e-40e6-9d12-b684c1a760d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:27.461612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617ec8d-b15e-40e6-9d12-b684c1a760d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:27.462520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617ec8d-b15e-40e6-9d12-b684c1a760d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:27.462947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617ec8d-b15e-40e6-9d12-b684c1a760d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:27.463239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1408ed-e50f-4377-a1cc-5802eddb7590 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:27.464704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617ec8d-b15e-40e6-9d12-b684c1a760d3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:27.494484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 264/537] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:27.503754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617ec8d-b15e-40e6-9d12-b684c1a760d3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:27.504508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325330c-8093-45d7-85e9-be74b6b62bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:27.505473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325330c-8093-45d7-85e9-be74b6b62bbc None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:27.505900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325330c-8093-45d7-85e9-be74b6b62bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:27.506318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325330c-8093-45d7-85e9-be74b6b62bbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:27.516284 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325330c-8093-45d7-85e9-be74b6b62bbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:27.518939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325330c-8093-45d7-85e9-be74b6b62bbc None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b325330c-8093-45d7-85e9-be74b6b62bbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:27.540159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:27.541156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:27.543119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:27.543119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:27.543119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:27.543119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:27.543119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:27.543119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:27.543119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:27.543119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:27.543119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 274/538] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:27.548929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325330c-8093-45d7-85e9-be74b6b62bbc None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:27.579311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:27.676326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325330c-8093-45d7-85e9-be74b6b62bbc None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:27.689286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617ec8d-b15e-40e6-9d12-b684c1a760d3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:27.719262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d3bcb-a55f-477b-8710-1b1a293e5534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:27.719826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d3bcb-a55f-477b-8710-1b1a293e5534 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:27.720116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d3bcb-a55f-477b-8710-1b1a293e5534 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:27.720393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d3bcb-a55f-477b-8710-1b1a293e5534 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:27.721683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d3bcb-a55f-477b-8710-1b1a293e5534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:27.721997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d3bcb-a55f-477b-8710-1b1a293e5534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:27.723613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d3bcb-a55f-477b-8710-1b1a293e5534 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:27.728225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:27.737530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 275/539] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:27.748121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d3bcb-a55f-477b-8710-1b1a293e5534 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:27.764738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178b347-3382-4152-a605-0612c239b1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:27.765394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178b347-3382-4152-a605-0612c239b1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:27.765680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178b347-3382-4152-a605-0612c239b1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:27.765953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178b347-3382-4152-a605-0612c239b1b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:27.766812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178b347-3382-4152-a605-0612c239b1b3 None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=a2a5d7aee47e43e9904a93c6ce3bb412) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:27.767125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178b347-3382-4152-a605-0612c239b1b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:27.768574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178b347-3382-4152-a605-0612c239b1b3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:27.781745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 265/540] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:27 2022] GET /identity/v3/role_assignments?user.id=a2a5d7aee47e43e9904a93c6ce3bb412&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:27.892730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:27.916121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d3bcb-a55f-477b-8710-1b1a293e5534 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:27.963835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718ddd-a101-42f0-9c79-d1fd828912a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:27.964504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718ddd-a101-42f0-9c79-d1fd828912a8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:27.964786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718ddd-a101-42f0-9c79-d1fd828912a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:27.965059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718ddd-a101-42f0-9c79-d1fd828912a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:27.965902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718ddd-a101-42f0-9c79-d1fd828912a8 None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=a26055489c284bcf8f0d418e4afffe73) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:27.966212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718ddd-a101-42f0-9c79-d1fd828912a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:27.967696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718ddd-a101-42f0-9c79-d1fd828912a8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:27.980469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 276/541] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:27 2022] GET /identity/v3/role_assignments?user.id=a26055489c284bcf8f0d418e4afffe73&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:28.160983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8958c-30c3-46c7-a02e-d50264e8ffdb None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:28.161522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8958c-30c3-46c7-a02e-d50264e8ffdb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:28.161522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8958c-30c3-46c7-a02e-d50264e8ffdb None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:28.163240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 266/542] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:28.169600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b1211-3690-4f95-a6eb-3b07d380b6c1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:28.169887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b1211-3690-4f95-a6eb-3b07d380b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:28.170169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b1211-3690-4f95-a6eb-3b07d380b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:28.192634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e09b1211-3690-4f95-a6eb-3b07d380b6c1 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:28.193863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e09b1211-3690-4f95-a6eb-3b07d380b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:28.276752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 277/543] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:28.301638 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8958c-30c3-46c7-a02e-d50264e8ffdb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:28.430735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8958c-30c3-46c7-a02e-d50264e8ffdb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:28.468134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d809163-69dc-41e2-9396-3589434cbf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:28.468957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d809163-69dc-41e2-9396-3589434cbf80 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:28.469238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d809163-69dc-41e2-9396-3589434cbf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:28.469575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d809163-69dc-41e2-9396-3589434cbf80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:28.482179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d809163-69dc-41e2-9396-3589434cbf80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-6d809163-69dc-41e2-9396-3589434cbf80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:28.490184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:28.491183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:28.492026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 267/544] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:28.498142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b1211-3690-4f95-a6eb-3b07d380b6c1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:28.579960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:28.621950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b1211-3690-4f95-a6eb-3b07d380b6c1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:28.671854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db208ed-6ccc-4b75-84c8-2ec7b2833ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:28.672523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db208ed-6ccc-4b75-84c8-2ec7b2833ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:28.672800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db208ed-6ccc-4b75-84c8-2ec7b2833ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:28.673071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db208ed-6ccc-4b75-84c8-2ec7b2833ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:28.673817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db208ed-6ccc-4b75-84c8-2ec7b2833ae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:28.674119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db208ed-6ccc-4b75-84c8-2ec7b2833ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:28.675500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db208ed-6ccc-4b75-84c8-2ec7b2833ae3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:28.680983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ae734-8285-4a71-aa03-f2829da660c5 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:28.681274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ae734-8285-4a71-aa03-f2829da660c5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:28.681556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ae734-8285-4a71-aa03-f2829da660c5 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:28.683745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 268/545] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:28.689663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40d6ec-ebc2-449c-8514-829a4f632ac9 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:28.689950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40d6ec-ebc2-449c-8514-829a4f632ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:28.690226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40d6ec-ebc2-449c-8514-829a4f632ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:28.693808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 278/546] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:28.701014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db208ed-6ccc-4b75-84c8-2ec7b2833ae3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:28.717941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8a40d6ec-ebc2-449c-8514-829a4f632ac9 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:28.719169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8a40d6ec-ebc2-449c-8514-829a4f632ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:28.809356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:28.837941 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db208ed-6ccc-4b75-84c8-2ec7b2833ae3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:28.864405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 269/547] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:28.893764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afd367-bb8d-410f-9c6a-a2a712faeb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:28.894932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd367-bb8d-410f-9c6a-a2a712faeb41 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:28.895497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd367-bb8d-410f-9c6a-a2a712faeb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:28.895985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd367-bb8d-410f-9c6a-a2a712faeb41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:28.902684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40d6ec-ebc2-449c-8514-829a4f632ac9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:28.919158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:28.938126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afd367-bb8d-410f-9c6a-a2a712faeb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:28.940049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afd367-bb8d-410f-9c6a-a2a712faeb41 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-39afd367-bb8d-410f-9c6a-a2a712faeb41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:28.966098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:28.967065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:28.968007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:28.968007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:28.968007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:28.968007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:28.975186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 279/548] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:28.983081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afd367-bb8d-410f-9c6a-a2a712faeb41 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:29.053251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40d6ec-ebc2-449c-8514-829a4f632ac9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:29.091197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab7ebc-9127-4a54-8834-7f71ba8bff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:29.092355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab7ebc-9127-4a54-8834-7f71ba8bff16 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:29.092852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab7ebc-9127-4a54-8834-7f71ba8bff16 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:29.093339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab7ebc-9127-4a54-8834-7f71ba8bff16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:29.104732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab7ebc-9127-4a54-8834-7f71ba8bff16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-97ab7ebc-9127-4a54-8834-7f71ba8bff16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:29.112886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:29.114197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:29.115133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:29.118160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 270/549] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:29.128087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab7ebc-9127-4a54-8834-7f71ba8bff16 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:29.194739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:29.226990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afd367-bb8d-410f-9c6a-a2a712faeb41 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:29.293794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2f926-aac9-49ff-9d3b-e1ada3228ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:29.294456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2f926-aac9-49ff-9d3b-e1ada3228ade None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:29.294760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2f926-aac9-49ff-9d3b-e1ada3228ade None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:29.295030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2f926-aac9-49ff-9d3b-e1ada3228ade None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:29.295751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2f926-aac9-49ff-9d3b-e1ada3228ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:29.296054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2f926-aac9-49ff-9d3b-e1ada3228ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:29.297426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2f926-aac9-49ff-9d3b-e1ada3228ade None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:29.317394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab7ebc-9127-4a54-8834-7f71ba8bff16 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:29.327335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 280/550] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:29.333732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2f926-aac9-49ff-9d3b-e1ada3228ade None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:29.388459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73c624-57fa-481c-bc19-683d135bb141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:29.389139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73c624-57fa-481c-bc19-683d135bb141 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:29.389420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73c624-57fa-481c-bc19-683d135bb141 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:29.389690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73c624-57fa-481c-bc19-683d135bb141 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:29.390436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73c624-57fa-481c-bc19-683d135bb141 None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:29.390758 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73c624-57fa-481c-bc19-683d135bb141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:29.393815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73c624-57fa-481c-bc19-683d135bb141 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:29.412929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 271/551] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:29.418843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73c624-57fa-481c-bc19-683d135bb141 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:29.429273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:29.532634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2f926-aac9-49ff-9d3b-e1ada3228ade None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:29.596156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ac819-851b-45f4-90a1-e02034f4d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:29.597375 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac819-851b-45f4-90a1-e02034f4d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:29.597947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac819-851b-45f4-90a1-e02034f4d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:29.599416 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac819-851b-45f4-90a1-e02034f4d1a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:29.612351 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ac819-851b-45f4-90a1-e02034f4d1a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:29.614934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ac819-851b-45f4-90a1-e02034f4d1a9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:29.616604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:29.622891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73c624-57fa-481c-bc19-683d135bb141 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-9d1ac819-851b-45f4-90a1-e02034f4d1a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:29.644117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:29.645280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:29.646235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:29.646235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:29.646235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:29.646235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:29.646235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:29.646235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:29.646235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:29.646235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:29.646235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:29.646235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:29.648935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 281/552] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:29.654418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ac819-851b-45f4-90a1-e02034f4d1a9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:29.693932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba914f3-a429-4d9c-8501-6c34135fd3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:29.695257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba914f3-a429-4d9c-8501-6c34135fd3fa None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:29.695760 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba914f3-a429-4d9c-8501-6c34135fd3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:29.696297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba914f3-a429-4d9c-8501-6c34135fd3fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:29.724079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba914f3-a429-4d9c-8501-6c34135fd3fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:29.725544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba914f3-a429-4d9c-8501-6c34135fd3fa None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-7ba914f3-a429-4d9c-8501-6c34135fd3fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:29.755647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:29.756609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:29.758035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:29.758035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:29.758035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:29.758035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:29.758035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 272/553] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:29.763335 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba914f3-a429-4d9c-8501-6c34135fd3fa None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:29.798053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ac819-851b-45f4-90a1-e02034f4d1a9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:29.809727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:29.867410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0145995-99c7-49bb-bae7-4a1786995ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:29.868084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0145995-99c7-49bb-bae7-4a1786995ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:29.868362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0145995-99c7-49bb-bae7-4a1786995ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:29.868638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0145995-99c7-49bb-bae7-4a1786995ac7 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:29.870508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0145995-99c7-49bb-bae7-4a1786995ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:29.870854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0145995-99c7-49bb-bae7-4a1786995ac7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:29.872306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0145995-99c7-49bb-bae7-4a1786995ac7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:29.911237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 282/554] 10.222.0.30 () {56 vars in 1135 bytes} [Mon May 23 17:54:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:29.916706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0145995-99c7-49bb-bae7-4a1786995ac7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:29.940274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba914f3-a429-4d9c-8501-6c34135fd3fa None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:30.025245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b5c9a-2def-4c11-8e51-bef659d03fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:30.026953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b5c9a-2def-4c11-8e51-bef659d03fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.027449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b5c9a-2def-4c11-8e51-bef659d03fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.027925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b5c9a-2def-4c11-8e51-bef659d03fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.029134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b5c9a-2def-4c11-8e51-bef659d03fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:30.029636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b5c9a-2def-4c11-8e51-bef659d03fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:30.031275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b5c9a-2def-4c11-8e51-bef659d03fc2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:30.042805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0145995-99c7-49bb-bae7-4a1786995ac7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:30.062070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 273/555] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:30.067429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b5c9a-2def-4c11-8e51-bef659d03fc2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:30.090767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:30.110953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9759cd9-542c-49b9-97a3-a77700f2da01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:30.111609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9759cd9-542c-49b9-97a3-a77700f2da01 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.111893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9759cd9-542c-49b9-97a3-a77700f2da01 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.112168 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9759cd9-542c-49b9-97a3-a77700f2da01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.203164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:30.239026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b5c9a-2def-4c11-8e51-bef659d03fc2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:30.259167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9759cd9-542c-49b9-97a3-a77700f2da01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:30.262098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9759cd9-542c-49b9-97a3-a77700f2da01 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:30.275300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fce0d-ca26-4733-80f7-8c33eada57ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:30.276776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fce0d-ca26-4733-80f7-8c33eada57ff None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.277060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fce0d-ca26-4733-80f7-8c33eada57ff None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.277334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fce0d-ca26-4733-80f7-8c33eada57ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.286006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fce0d-ca26-4733-80f7-8c33eada57ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:30.287649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fce0d-ca26-4733-80f7-8c33eada57ff None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b87fce0d-ca26-4733-80f7-8c33eada57ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:30.304954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:30.306897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 274/556] 10.222.0.30 () {56 vars in 1093 bytes} [Mon May 23 17:54:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:30.307823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64ef7c-b9f9-4e84-a002-cbd5a5146e9e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.308474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64ef7c-b9f9-4e84-a002-cbd5a5146e9e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.308474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64ef7c-b9f9-4e84-a002-cbd5a5146e9e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.313425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 275/557] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:30.313425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64ef7c-b9f9-4e84-a002-cbd5a5146e9e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:30.384681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:30.395113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 283/558] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:54:30.396431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b844-1204-4204-b5c5-564c5b18a42e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.396720 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b844-1204-4204-b5c5-564c5b18a42e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.396997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b844-1204-4204-b5c5-564c5b18a42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.413729 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e490b844-1204-4204-b5c5-564c5b18a42e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:30.414991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e490b844-1204-4204-b5c5-564c5b18a42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:30.429384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64ef7c-b9f9-4e84-a002-cbd5a5146e9e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:30.467002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3ccd6-20ae-4ba2-8dc0-bb5a4bb6ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:30.467599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3ccd6-20ae-4ba2-8dc0-bb5a4bb6ac93 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.467886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3ccd6-20ae-4ba2-8dc0-bb5a4bb6ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.468165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3ccd6-20ae-4ba2-8dc0-bb5a4bb6ac93 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.469002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3ccd6-20ae-4ba2-8dc0-bb5a4bb6ac93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:30.469313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3ccd6-20ae-4ba2-8dc0-bb5a4bb6ac93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:30.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3ccd6-20ae-4ba2-8dc0-bb5a4bb6ac93 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:30.477160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:30.486668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 284/559] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:30.494834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 276/560] 10.222.0.30 () {56 vars in 1133 bytes} [Mon May 23 17:54:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:30.494834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3ccd6-20ae-4ba2-8dc0-bb5a4bb6ac93 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:30.500116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6e24-6013-4f57-9ece-8d8d0465bb2e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.500409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6e24-6013-4f57-9ece-8d8d0465bb2e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.500691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc6e24-6013-4f57-9ece-8d8d0465bb2e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.502224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 285/561] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:30 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:30.510501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc6e24-6013-4f57-9ece-8d8d0465bb2e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:30.621862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3ccd6-20ae-4ba2-8dc0-bb5a4bb6ac93 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:30.629209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc6e24-6013-4f57-9ece-8d8d0465bb2e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:30.651090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:30.659959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75246478-9f6a-4e76-8b5e-071d90f37c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:30.660758 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75246478-9f6a-4e76-8b5e-071d90f37c4c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.661044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75246478-9f6a-4e76-8b5e-071d90f37c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.661320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75246478-9f6a-4e76-8b5e-071d90f37c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.667102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21c334-3ce2-4bb4-a1bb-a64a62a79e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:30.667895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21c334-3ce2-4bb4-a1bb-a64a62a79e2c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.668176 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21c334-3ce2-4bb4-a1bb-a64a62a79e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.668452 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21c334-3ce2-4bb4-a1bb-a64a62a79e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.671698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75246478-9f6a-4e76-8b5e-071d90f37c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:30.673177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75246478-9f6a-4e76-8b5e-071d90f37c4c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:30.678828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21c334-3ce2-4bb4-a1bb-a64a62a79e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:30.680266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21c334-3ce2-4bb4-a1bb-a64a62a79e2c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-75246478-9f6a-4e76-8b5e-071d90f37c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:30.691941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:30.692833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:30.693729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:30.693729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:30.693729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:30.693729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:30.698378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 277/562] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-4e21c334-3ce2-4bb4-a1bb-a64a62a79e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:30.699478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:30.700322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:30.706469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:30.706469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:30.706469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:30.706469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:30.707002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da64d7-6f96-4fd5-bd50-bdeb632205d6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.707002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da64d7-6f96-4fd5-bd50-bdeb632205d6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.707002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da64d7-6f96-4fd5-bd50-bdeb632205d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.707748 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 286/563] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:30.707748 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21c334-3ce2-4bb4-a1bb-a64a62a79e2c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:30.720726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d0da64d7-6f96-4fd5-bd50-bdeb632205d6 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:30.721848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d0da64d7-6f96-4fd5-bd50-bdeb632205d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:30.754469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:30.799565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 278/564] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:30.800409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da64d7-6f96-4fd5-bd50-bdeb632205d6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:30.818582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21c334-3ce2-4bb4-a1bb-a64a62a79e2c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:30.852923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fef6a-8d9a-4f95-8b99-e3e93c2cd19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:30.853775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fef6a-8d9a-4f95-8b99-e3e93c2cd19b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.854063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fef6a-8d9a-4f95-8b99-e3e93c2cd19b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.854437 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fef6a-8d9a-4f95-8b99-e3e93c2cd19b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.865160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fef6a-8d9a-4f95-8b99-e3e93c2cd19b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-df0fef6a-8d9a-4f95-8b99-e3e93c2cd19b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:30.873815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:30.874852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:30.875683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 287/565] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:30.876925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fef6a-8d9a-4f95-8b99-e3e93c2cd19b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:30.903364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da64d7-6f96-4fd5-bd50-bdeb632205d6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:30.913650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:30.937826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166dc6-c964-453d-b497-99ee8b0fee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:30.938488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166dc6-c964-453d-b497-99ee8b0fee96 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.938800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166dc6-c964-453d-b497-99ee8b0fee96 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.939081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166dc6-c964-453d-b497-99ee8b0fee96 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.939797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166dc6-c964-453d-b497-99ee8b0fee96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:30.940106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166dc6-c964-453d-b497-99ee8b0fee96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:30.941501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166dc6-c964-453d-b497-99ee8b0fee96 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:30.953334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 279/566] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:30.954610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfc56f-0546-432b-9a60-fb0ccfdefa87 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:30.954950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfc56f-0546-432b-9a60-fb0ccfdefa87 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:30.955253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfc56f-0546-432b-9a60-fb0ccfdefa87 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:30.956482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 280/567] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:30.957196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfc56f-0546-432b-9a60-fb0ccfdefa87 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:30.982942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fef6a-8d9a-4f95-8b99-e3e93c2cd19b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:30.989587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:31.017032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13043ac-3fc1-441e-b46b-5eee976bba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.017691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13043ac-3fc1-441e-b46b-5eee976bba7f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.017968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13043ac-3fc1-441e-b46b-5eee976bba7f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.018262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13043ac-3fc1-441e-b46b-5eee976bba7f None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.019007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13043ac-3fc1-441e-b46b-5eee976bba7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:31.019314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13043ac-3fc1-441e-b46b-5eee976bba7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:31.020711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13043ac-3fc1-441e-b46b-5eee976bba7f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:31.032306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 288/568] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:31.033094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13043ac-3fc1-441e-b46b-5eee976bba7f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.060513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfc56f-0546-432b-9a60-fb0ccfdefa87 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.100772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425debfd-d7a6-41fc-8176-2761dec8f1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.101943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425debfd-d7a6-41fc-8176-2761dec8f1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.102401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425debfd-d7a6-41fc-8176-2761dec8f1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.102862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425debfd-d7a6-41fc-8176-2761dec8f1f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.118632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425debfd-d7a6-41fc-8176-2761dec8f1f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-425debfd-d7a6-41fc-8176-2761dec8f1f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:31.131440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:31.132547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 281/569] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:31.139658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425debfd-d7a6-41fc-8176-2761dec8f1f9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.140458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13043ac-3fc1-441e-b46b-5eee976bba7f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.168519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:31.172377 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba73ca-37fc-4fca-aa4d-013ef08c70b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.173039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba73ca-37fc-4fca-aa4d-013ef08c70b0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.173318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba73ca-37fc-4fca-aa4d-013ef08c70b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.173590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba73ca-37fc-4fca-aa4d-013ef08c70b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.174330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba73ca-37fc-4fca-aa4d-013ef08c70b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:31.174636 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba73ca-37fc-4fca-aa4d-013ef08c70b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:31.176017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba73ca-37fc-4fca-aa4d-013ef08c70b0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:31.184844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 289/570] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:31.186020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e299ac5-7144-46cc-8c7f-ab5344ad16b0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.186303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e299ac5-7144-46cc-8c7f-ab5344ad16b0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.186577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e299ac5-7144-46cc-8c7f-ab5344ad16b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.202314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5e299ac5-7144-46cc-8c7f-ab5344ad16b0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:31.203526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5e299ac5-7144-46cc-8c7f-ab5344ad16b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:31.226166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:31.242766 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425debfd-d7a6-41fc-8176-2761dec8f1f9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.270917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 290/571] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:31.271737 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e299ac5-7144-46cc-8c7f-ab5344ad16b0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.276633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341c9d9-0dd0-4a01-8f4e-493e8ba9fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.277427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341c9d9-0dd0-4a01-8f4e-493e8ba9fbab None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.277711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341c9d9-0dd0-4a01-8f4e-493e8ba9fbab None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.277984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341c9d9-0dd0-4a01-8f4e-493e8ba9fbab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.284806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341c9d9-0dd0-4a01-8f4e-493e8ba9fbab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:31.286261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341c9d9-0dd0-4a01-8f4e-493e8ba9fbab None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5341c9d9-0dd0-4a01-8f4e-493e8ba9fbab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:31.302995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:31.304107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:31.305043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:31.305043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:31.305043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:31.305043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:31.305043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:31.305043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:31.305043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:31.305043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:31.305043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 282/572] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:31.305559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341c9d9-0dd0-4a01-8f4e-493e8ba9fbab None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.385533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e299ac5-7144-46cc-8c7f-ab5344ad16b0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.396086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:31.408094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341c9d9-0dd0-4a01-8f4e-493e8ba9fbab None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.423889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892c79c-c2fc-4bc9-8fb2-b94b427d4a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.424681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892c79c-c2fc-4bc9-8fb2-b94b427d4a1f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.425252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892c79c-c2fc-4bc9-8fb2-b94b427d4a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.425528 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892c79c-c2fc-4bc9-8fb2-b94b427d4a1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.432126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892c79c-c2fc-4bc9-8fb2-b94b427d4a1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:31.433560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892c79c-c2fc-4bc9-8fb2-b94b427d4a1f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:31.442410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ed517-d9b2-49f4-ab53-6f763c8d8048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.443129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ed517-d9b2-49f4-ab53-6f763c8d8048 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.443418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ed517-d9b2-49f4-ab53-6f763c8d8048 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.443697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ed517-d9b2-49f4-ab53-6f763c8d8048 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.444437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ed517-d9b2-49f4-ab53-6f763c8d8048 None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:31.444746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ed517-d9b2-49f4-ab53-6f763c8d8048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:31.446094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ed517-d9b2-49f4-ab53-6f763c8d8048 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-3892c79c-c2fc-4bc9-8fb2-b94b427d4a1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:31.447069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:31.448026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:31.449132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:31.449132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:31.449132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:31.449132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:31.449132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:31.449132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:31.449132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:31.449132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:31.449132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 291/573] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:31.449837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892c79c-c2fc-4bc9-8fb2-b94b427d4a1f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.462196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 283/574] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:31.462196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ed517-d9b2-49f4-ab53-6f763c8d8048 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.471051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:31.553461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892c79c-c2fc-4bc9-8fb2-b94b427d4a1f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.564265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ed517-d9b2-49f4-ab53-6f763c8d8048 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.586791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864893e5-2d17-4f0f-849d-f12ad0ae85e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.587585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864893e5-2d17-4f0f-849d-f12ad0ae85e9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.587866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864893e5-2d17-4f0f-849d-f12ad0ae85e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.588696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864893e5-2d17-4f0f-849d-f12ad0ae85e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.598236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1079ecc-c99b-4612-a941-7c5c03a11eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.599051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1079ecc-c99b-4612-a941-7c5c03a11eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.599318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864893e5-2d17-4f0f-849d-f12ad0ae85e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:31.599437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1079ecc-c99b-4612-a941-7c5c03a11eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.599598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1079ecc-c99b-4612-a941-7c5c03a11eb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.600755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864893e5-2d17-4f0f-849d-f12ad0ae85e9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:31.609677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1079ecc-c99b-4612-a941-7c5c03a11eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c1079ecc-c99b-4612-a941-7c5c03a11eb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:31.617432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:31.618533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:31.624648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-864893e5-2d17-4f0f-849d-f12ad0ae85e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:31.625323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:31.626112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:31.627026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:31.627026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:31.627026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:31.627026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:31.627244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 284/575] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:31.627244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1079ecc-c99b-4612-a941-7c5c03a11eb7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.627383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 292/576] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:31.627383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864893e5-2d17-4f0f-849d-f12ad0ae85e9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.640516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:31.691602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:31.724977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864893e5-2d17-4f0f-849d-f12ad0ae85e9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.725183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1079ecc-c99b-4612-a941-7c5c03a11eb7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.758195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9133-41a9-4bc2-86bb-8a2af74ac20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.758889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e90a2-9252-4202-b705-fc05e038f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.759127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9133-41a9-4bc2-86bb-8a2af74ac20a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.759410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9133-41a9-4bc2-86bb-8a2af74ac20a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.759550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e90a2-9252-4202-b705-fc05e038f560 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.759681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9133-41a9-4bc2-86bb-8a2af74ac20a None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.759874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e90a2-9252-4202-b705-fc05e038f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.760149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e90a2-9252-4202-b705-fc05e038f560 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.760697 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc9133-41a9-4bc2-86bb-8a2af74ac20a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:31.760929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e90a2-9252-4202-b705-fc05e038f560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:31.761028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc9133-41a9-4bc2-86bb-8a2af74ac20a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:31.761242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e90a2-9252-4202-b705-fc05e038f560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:31.762427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc9133-41a9-4bc2-86bb-8a2af74ac20a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:31.762679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e90a2-9252-4202-b705-fc05e038f560 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:31.774432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 293/577] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:31.774911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 285/578] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:31.775188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9133-41a9-4bc2-86bb-8a2af74ac20a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.775764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e90a2-9252-4202-b705-fc05e038f560 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.848715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:31.879098 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e90a2-9252-4202-b705-fc05e038f560 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.882052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9133-41a9-4bc2-86bb-8a2af74ac20a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:31.910065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:31.912546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d323f-b726-4ada-9002-280a4d450aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.913215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d323f-b726-4ada-9002-280a4d450aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.913501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d323f-b726-4ada-9002-280a4d450aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.913780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d323f-b726-4ada-9002-280a4d450aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.914522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d323f-b726-4ada-9002-280a4d450aa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:31.914862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d323f-b726-4ada-9002-280a4d450aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:31.916796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d323f-b726-4ada-9002-280a4d450aa4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:31.917503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0a121-9229-4986-a69f-d8290af58c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:31.918288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a121-9229-4986-a69f-d8290af58c24 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:31.918563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a121-9229-4986-a69f-d8290af58c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:31.918871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a121-9229-4986-a69f-d8290af58c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:31.924774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 286/579] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:31.925560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d323f-b726-4ada-9002-280a4d450aa4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:31.928949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0a121-9229-4986-a69f-d8290af58c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:31.930532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0a121-9229-4986-a69f-d8290af58c24 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-79d0a121-9229-4986-a69f-d8290af58c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:31.949715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:31.950624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:31.951531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:31.951531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:31.951531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:31.951531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:31.951531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 294/580] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:31.951817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0a121-9229-4986-a69f-d8290af58c24 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.027280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d323f-b726-4ada-9002-280a4d450aa4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:32.049488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0a121-9229-4986-a69f-d8290af58c24 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:32.060368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a0585-037b-4734-9564-ae6d24345662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:32.061025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a0585-037b-4734-9564-ae6d24345662 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:32.061304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a0585-037b-4734-9564-ae6d24345662 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:32.061584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a0585-037b-4734-9564-ae6d24345662 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:32.062287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a0585-037b-4734-9564-ae6d24345662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:32.062591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a0585-037b-4734-9564-ae6d24345662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:32.063988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a0585-037b-4734-9564-ae6d24345662 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:32.065453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:32.076891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 287/581] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:32.077667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a0585-037b-4734-9564-ae6d24345662 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.085253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01b83-adac-4e1d-a01f-471ffef65738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:32.085904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01b83-adac-4e1d-a01f-471ffef65738 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:32.086186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01b83-adac-4e1d-a01f-471ffef65738 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:32.086456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01b83-adac-4e1d-a01f-471ffef65738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:32.087320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c01b83-adac-4e1d-a01f-471ffef65738 None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=fcbd7035e027494cb063489b375cb385) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:32.087632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c01b83-adac-4e1d-a01f-471ffef65738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:32.089713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c01b83-adac-4e1d-a01f-471ffef65738 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:32.095191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 295/582] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:31 2022] GET /identity/v3/role_assignments?user.id=fcbd7035e027494cb063489b375cb385&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:32.095948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01b83-adac-4e1d-a01f-471ffef65738 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.156361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:32.193373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a0585-037b-4734-9564-ae6d24345662 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:32.218294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01b83-adac-4e1d-a01f-471ffef65738 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:32.237336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020ee25-421b-48a7-8309-99e6a53b4246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:32.238235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020ee25-421b-48a7-8309-99e6a53b4246 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:32.238518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020ee25-421b-48a7-8309-99e6a53b4246 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:32.238825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020ee25-421b-48a7-8309-99e6a53b4246 None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/9021e2249e11489083139e210562ce44/roles/ced991a120aa41709516ad31b1c57a89` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:32.255769 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020ee25-421b-48a7-8309-99e6a53b4246 None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=9021e2249e11489083139e210562ce44, role_id=ced991a120aa41709516ad31b1c57a89)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:32.257246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020ee25-421b-48a7-8309-99e6a53b4246 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:32.260898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574a1f0-45d0-4d0d-a49d-2b355d1987c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:32.261726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574a1f0-45d0-4d0d-a49d-2b355d1987c7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:32.262012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574a1f0-45d0-4d0d-a49d-2b355d1987c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:32.262362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574a1f0-45d0-4d0d-a49d-2b355d1987c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:32.273830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 288/583] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:54:32 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/9021e2249e11489083139e210562ce44/roles/ced991a120aa41709516ad31b1c57a89 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:32.274618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020ee25-421b-48a7-8309-99e6a53b4246 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.274848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574a1f0-45d0-4d0d-a49d-2b355d1987c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:32.276370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574a1f0-45d0-4d0d-a49d-2b355d1987c7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e574a1f0-45d0-4d0d-a49d-2b355d1987c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:32.295997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:32.296959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:32.298101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:32.298101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:32.298101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:32.298101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:32.298101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 296/584] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:32.298384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574a1f0-45d0-4d0d-a49d-2b355d1987c7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.334652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:32.424084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:32.429306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574a1f0-45d0-4d0d-a49d-2b355d1987c7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:32.442274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020ee25-421b-48a7-8309-99e6a53b4246 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:32.480991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690d2eb-5db1-4651-b9ef-49ebce5b5f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:32.482140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690d2eb-5db1-4651-b9ef-49ebce5b5f83 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:32.482493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690d2eb-5db1-4651-b9ef-49ebce5b5f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:32.483439 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690d2eb-5db1-4651-b9ef-49ebce5b5f83 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:32.491604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690d2eb-5db1-4651-b9ef-49ebce5b5f83 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:32.493002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099b8a0-c3d7-4fc9-a43a-8763b18a8202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:32.493308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690d2eb-5db1-4651-b9ef-49ebce5b5f83 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:32.493818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099b8a0-c3d7-4fc9-a43a-8763b18a8202 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:32.494258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099b8a0-c3d7-4fc9-a43a-8763b18a8202 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:32.495177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099b8a0-c3d7-4fc9-a43a-8763b18a8202 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:32.496094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099b8a0-c3d7-4fc9-a43a-8763b18a8202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:32.496415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099b8a0-c3d7-4fc9-a43a-8763b18a8202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:32.497776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099b8a0-c3d7-4fc9-a43a-8763b18a8202 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:32.512136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 289/585] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:32.513004 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099b8a0-c3d7-4fc9-a43a-8763b18a8202 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-6690d2eb-5db1-4651-b9ef-49ebce5b5f83 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:32.516535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:32.517445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:32.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:32.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:32.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:32.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:32.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:32.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:32.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:32.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:32.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:54:32.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:32.522195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 297/586] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:32.523009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690d2eb-5db1-4651-b9ef-49ebce5b5f83 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.639122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690d2eb-5db1-4651-b9ef-49ebce5b5f83 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:32.656039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099b8a0-c3d7-4fc9-a43a-8763b18a8202 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:32.659084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:32.682252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ac223-1e53-4bd0-a8f9-379924730268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:32.683111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ac223-1e53-4bd0-a8f9-379924730268 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:32.683392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ac223-1e53-4bd0-a8f9-379924730268 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:32.683661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ac223-1e53-4bd0-a8f9-379924730268 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:32.694324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ac223-1e53-4bd0-a8f9-379924730268 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:32.696498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ac223-1e53-4bd0-a8f9-379924730268 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:32.700772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63958414-aa08-439f-aff8-0ce4c73c01d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:32.701679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63958414-aa08-439f-aff8-0ce4c73c01d0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:32.702184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63958414-aa08-439f-aff8-0ce4c73c01d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:32.702668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63958414-aa08-439f-aff8-0ce4c73c01d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:32.703625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63958414-aa08-439f-aff8-0ce4c73c01d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:32.704144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63958414-aa08-439f-aff8-0ce4c73c01d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:32.705731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63958414-aa08-439f-aff8-0ce4c73c01d0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-269ac223-1e53-4bd0-a8f9-379924730268 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:32.713792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:32.714764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:32.715719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:32.715719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:32.715719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:32.715719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:32.715719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:32.715719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:32.715719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:32.715719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:32.715719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 17:54:32.715719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:32.718846 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 298/587] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:32.719928 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ac223-1e53-4bd0-a8f9-379924730268 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.727437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 290/588] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:32.728301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63958414-aa08-439f-aff8-0ce4c73c01d0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.745216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:32.833294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ac223-1e53-4bd0-a8f9-379924730268 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:32.847682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63958414-aa08-439f-aff8-0ce4c73c01d0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:32.869881 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f9b43-3547-4f17-92d6-95cf2f0fd8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:32.871138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f9b43-3547-4f17-92d6-95cf2f0fd8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:32.871641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f9b43-3547-4f17-92d6-95cf2f0fd8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:32.872106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f9b43-3547-4f17-92d6-95cf2f0fd8d1 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:32.873141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f9b43-3547-4f17-92d6-95cf2f0fd8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:32.873641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f9b43-3547-4f17-92d6-95cf2f0fd8d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:32.875291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f9b43-3547-4f17-92d6-95cf2f0fd8d1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:32.888574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04152fae-4740-402c-80d4-68d687bd6568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:32.889311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04152fae-4740-402c-80d4-68d687bd6568 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:32.889542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04152fae-4740-402c-80d4-68d687bd6568 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:32.889822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04152fae-4740-402c-80d4-68d687bd6568 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:32.890662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04152fae-4740-402c-80d4-68d687bd6568 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:32.891020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04152fae-4740-402c-80d4-68d687bd6568 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:32.892579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04152fae-4740-402c-80d4-68d687bd6568 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:32.896457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 299/589] 10.222.0.30 () {56 vars in 1137 bytes} [Mon May 23 17:54:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:32.897549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f9b43-3547-4f17-92d6-95cf2f0fd8d1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.917164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 291/590] 10.222.0.30 () {56 vars in 1137 bytes} [Mon May 23 17:54:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:32.918431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04152fae-4740-402c-80d4-68d687bd6568 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:32.949434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:33.006973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:33.041752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04152fae-4740-402c-80d4-68d687bd6568 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:33.043422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f9b43-3547-4f17-92d6-95cf2f0fd8d1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:33.084451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674bb8-d7ca-4f6a-a4cb-842065de5bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:33.085825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674bb8-d7ca-4f6a-a4cb-842065de5bef None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:33.086322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674bb8-d7ca-4f6a-a4cb-842065de5bef None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:33.086829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674bb8-d7ca-4f6a-a4cb-842065de5bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:33.087020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71e3b2-adba-4b33-803b-aac394a0a409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:33.087946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e3b2-adba-4b33-803b-aac394a0a409 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:33.088292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e3b2-adba-4b33-803b-aac394a0a409 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:33.088565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e3b2-adba-4b33-803b-aac394a0a409 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:33.096323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71e3b2-adba-4b33-803b-aac394a0a409 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:33.097643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71e3b2-adba-4b33-803b-aac394a0a409 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:33.101151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d674bb8-d7ca-4f6a-a4cb-842065de5bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:33.102829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d674bb8-d7ca-4f6a-a4cb-842065de5bef None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-eb71e3b2-adba-4b33-803b-aac394a0a409 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:33.112818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:33.113844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:33.114833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:33.114833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:33.114833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:33.114833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:33.114833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:33.114833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:33.114833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:33.114833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:33.114833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:54:33.114833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:33.118541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 300/591] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:33.119978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71e3b2-adba-4b33-803b-aac394a0a409 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-4d674bb8-d7ca-4f6a-a4cb-842065de5bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:33.127274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:33.128151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:33.129048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:33.129048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:33.129048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:33.129048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:33.131104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 292/592] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:33.132568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674bb8-d7ca-4f6a-a4cb-842065de5bef None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:33.232920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:33.234118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71e3b2-adba-4b33-803b-aac394a0a409 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:33.261715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674bb8-d7ca-4f6a-a4cb-842065de5bef None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:33.283300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf3662-34ec-493b-ad37-537c56b2e353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:33.284423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf3662-34ec-493b-ad37-537c56b2e353 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:33.285614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf3662-34ec-493b-ad37-537c56b2e353 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:33.286060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf3662-34ec-493b-ad37-537c56b2e353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:33.290863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:33.302546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1e4d9-dcc4-4d47-b187-67a7a7e5cf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:33.303358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e4d9-dcc4-4d47-b187-67a7a7e5cf53 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:33.303734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e4d9-dcc4-4d47-b187-67a7a7e5cf53 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:33.304125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e4d9-dcc4-4d47-b187-67a7a7e5cf53 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:33.304349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf3662-34ec-493b-ad37-537c56b2e353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:33.305141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1e4d9-dcc4-4d47-b187-67a7a7e5cf53 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:33.305543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1e4d9-dcc4-4d47-b187-67a7a7e5cf53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:33.306299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf3662-34ec-493b-ad37-537c56b2e353 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:33.307448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1e4d9-dcc4-4d47-b187-67a7a7e5cf53 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:33.329943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 293/593] 10.222.0.30 () {56 vars in 1139 bytes} [Mon May 23 17:54:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:33.331112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1e4d9-dcc4-4d47-b187-67a7a7e5cf53 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-fbbf3662-34ec-493b-ad37-537c56b2e353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:33.332088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:33.332962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:33.333837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:33.333837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:33.333837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:33.333837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:33.337669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 301/594] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:33.338692 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf3662-34ec-493b-ad37-537c56b2e353 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:33.442241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1e4d9-dcc4-4d47-b187-67a7a7e5cf53 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:33.454654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf3662-34ec-493b-ad37-537c56b2e353 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:33.473261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:33.481164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacfa79-1585-4422-955e-ec58ce27bf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:33.481681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacfa79-1585-4422-955e-ec58ce27bf75 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:33.481960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacfa79-1585-4422-955e-ec58ce27bf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:33.482232 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacfa79-1585-4422-955e-ec58ce27bf75 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:33.483063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacfa79-1585-4422-955e-ec58ce27bf75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:33.483316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacfa79-1585-4422-955e-ec58ce27bf75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:33.484750 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacfa79-1585-4422-955e-ec58ce27bf75 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:33.494352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9fb5-3710-4076-8118-993dadc703f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:33.495449 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9fb5-3710-4076-8118-993dadc703f0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:33.495902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9fb5-3710-4076-8118-993dadc703f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:33.496322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9fb5-3710-4076-8118-993dadc703f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:33.498773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 294/595] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:33.499856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacfa79-1585-4422-955e-ec58ce27bf75 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:33.507940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef9fb5-3710-4076-8118-993dadc703f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:33.510453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef9fb5-3710-4076-8118-993dadc703f0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-3cef9fb5-3710-4076-8118-993dadc703f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:33.532170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:33.533275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:33.534651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:33.534651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:33.534651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:33.534651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:33.540646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 302/596] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:33.542454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9fb5-3710-4076-8118-993dadc703f0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:33.589239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:33.613086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacfa79-1585-4422-955e-ec58ce27bf75 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:33.653746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a5b7f-e9b3-4a5d-804a-1f742d88cf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:33.654762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a5b7f-e9b3-4a5d-804a-1f742d88cf4c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:33.655239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a5b7f-e9b3-4a5d-804a-1f742d88cf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:33.655938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a5b7f-e9b3-4a5d-804a-1f742d88cf4c None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:33.657022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a5b7f-e9b3-4a5d-804a-1f742d88cf4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:33.657494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a5b7f-e9b3-4a5d-804a-1f742d88cf4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:33.659137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a5b7f-e9b3-4a5d-804a-1f742d88cf4c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:33.666551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9fb5-3710-4076-8118-993dadc703f0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:33.673761 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 295/597] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:33.674962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a5b7f-e9b3-4a5d-804a-1f742d88cf4c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:33.725261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec66a2-f06f-44e6-a2b8-2cb874782b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:33.726063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec66a2-f06f-44e6-a2b8-2cb874782b02 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:33.726342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec66a2-f06f-44e6-a2b8-2cb874782b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:33.726613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec66a2-f06f-44e6-a2b8-2cb874782b02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:33.736505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec66a2-f06f-44e6-a2b8-2cb874782b02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:33.737884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec66a2-f06f-44e6-a2b8-2cb874782b02 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:33.739991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e2ec66a2-f06f-44e6-a2b8-2cb874782b02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:33.760510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:33.761521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:33.762432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:33.762432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:33.762432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:33.762432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:33.762432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:33.762432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:33.762432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:33.762432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:33.762432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 303/598] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:33.762960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec66a2-f06f-44e6-a2b8-2cb874782b02 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:33.802772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a5b7f-e9b3-4a5d-804a-1f742d88cf4c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:33.854993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6fe75-dd4a-481a-9604-6c05b0e223f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:33.856330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6fe75-dd4a-481a-9604-6c05b0e223f7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:33.857129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6fe75-dd4a-481a-9604-6c05b0e223f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:33.858721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6fe75-dd4a-481a-9604-6c05b0e223f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:33.859775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6fe75-dd4a-481a-9604-6c05b0e223f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:33.860293 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6fe75-dd4a-481a-9604-6c05b0e223f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:33.863286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6fe75-dd4a-481a-9604-6c05b0e223f7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:33.885692 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 296/599] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:33.888178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:33.889034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6fe75-dd4a-481a-9604-6c05b0e223f7 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:33.890793 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec66a2-f06f-44e6-a2b8-2cb874782b02 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:33.941294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8301-6abd-481e-a9b2-253365f1f3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:33.942905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8301-6abd-481e-a9b2-253365f1f3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:33.943768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8301-6abd-481e-a9b2-253365f1f3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:33.944609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f8301-6abd-481e-a9b2-253365f1f3e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:33.953534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f8301-6abd-481e-a9b2-253365f1f3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:33.955413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f8301-6abd-481e-a9b2-253365f1f3e6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b82f8301-6abd-481e-a9b2-253365f1f3e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:33.973326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:33.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:33.975243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:33.975243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:33.975243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:33.975243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:33.975243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:33.975243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:33.975243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:33.975243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:33.978301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 304/600] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:33.979446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8301-6abd-481e-a9b2-253365f1f3e6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:34.024605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6fe75-dd4a-481a-9604-6c05b0e223f7 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:34.046055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:34.077969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d8005-5a60-416e-9ee2-c195280d8466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:34.078647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d8005-5a60-416e-9ee2-c195280d8466 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.078953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d8005-5a60-416e-9ee2-c195280d8466 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.079230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d8005-5a60-416e-9ee2-c195280d8466 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.080019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d8005-5a60-416e-9ee2-c195280d8466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:34.080326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d8005-5a60-416e-9ee2-c195280d8466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:34.083148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d8005-5a60-416e-9ee2-c195280d8466 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:34.112688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 297/601] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:34.114254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d8005-5a60-416e-9ee2-c195280d8466 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:34.119402 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f8301-6abd-481e-a9b2-253365f1f3e6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:34.166217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e62f-43e0-4137-abf6-f24f87694a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:34.167662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e62f-43e0-4137-abf6-f24f87694a0b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.168188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e62f-43e0-4137-abf6-f24f87694a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.168686 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e62f-43e0-4137-abf6-f24f87694a0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.178782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e62f-43e0-4137-abf6-f24f87694a0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:34.180760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e62f-43e0-4137-abf6-f24f87694a0b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e105e62f-43e0-4137-abf6-f24f87694a0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:34.202634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:34.203599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:34.204481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:34.204481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:34.204481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:34.204481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:34.204481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:34.204481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:34.204481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:34.204481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:34.211559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 305/602] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:34.212950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e62f-43e0-4137-abf6-f24f87694a0b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:34.240946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:34.242005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d8005-5a60-416e-9ee2-c195280d8466 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:34.282904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b141ae-ca61-4808-86f2-c3934753e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:34.283516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b141ae-ca61-4808-86f2-c3934753e829 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.283798 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b141ae-ca61-4808-86f2-c3934753e829 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.284018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b141ae-ca61-4808-86f2-c3934753e829 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.284909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b141ae-ca61-4808-86f2-c3934753e829 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:34.285221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b141ae-ca61-4808-86f2-c3934753e829 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:34.286739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b141ae-ca61-4808-86f2-c3934753e829 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:34.307668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 298/603] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:34.308679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b141ae-ca61-4808-86f2-c3934753e829 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:34.346030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e62f-43e0-4137-abf6-f24f87694a0b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:34.355386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:34.394069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb796a-ea82-48ac-b1a6-ac1d0ec03907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:34.395405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb796a-ea82-48ac-b1a6-ac1d0ec03907 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.395933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb796a-ea82-48ac-b1a6-ac1d0ec03907 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.396513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb796a-ea82-48ac-b1a6-ac1d0ec03907 None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/e8eae73572d54dcaac9f3f6bb24df316/roles/ced991a120aa41709516ad31b1c57a89` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.417235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb796a-ea82-48ac-b1a6-ac1d0ec03907 None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=e8eae73572d54dcaac9f3f6bb24df316, role_id=ced991a120aa41709516ad31b1c57a89)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:34.419210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb796a-ea82-48ac-b1a6-ac1d0ec03907 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:34.438328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b141ae-ca61-4808-86f2-c3934753e829 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:34.440434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 306/604] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:54:34 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/e8eae73572d54dcaac9f3f6bb24df316/roles/ced991a120aa41709516ad31b1c57a89 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:34.443018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb796a-ea82-48ac-b1a6-ac1d0ec03907 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:34.489078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3514f5-fcff-4f19-b09c-96fb2c987563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:34.497500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3514f5-fcff-4f19-b09c-96fb2c987563 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.497500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3514f5-fcff-4f19-b09c-96fb2c987563 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.497500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3514f5-fcff-4f19-b09c-96fb2c987563 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.497500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3514f5-fcff-4f19-b09c-96fb2c987563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:34.497500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3514f5-fcff-4f19-b09c-96fb2c987563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:34.497500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3514f5-fcff-4f19-b09c-96fb2c987563 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:34.518891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 299/605] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:34.531002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3514f5-fcff-4f19-b09c-96fb2c987563 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:34.584423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:34.629261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb796a-ea82-48ac-b1a6-ac1d0ec03907 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:34.669904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:34.682939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64424a75-7496-423d-9820-28e349e516c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:34.683926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64424a75-7496-423d-9820-28e349e516c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.684212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64424a75-7496-423d-9820-28e349e516c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.684486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64424a75-7496-423d-9820-28e349e516c6 None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/a2a5d7aee47e43e9904a93c6ce3bb412/roles/ced991a120aa41709516ad31b1c57a89` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.684775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3514f5-fcff-4f19-b09c-96fb2c987563 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:34.705872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64424a75-7496-423d-9820-28e349e516c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=a2a5d7aee47e43e9904a93c6ce3bb412, role_id=ced991a120aa41709516ad31b1c57a89)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:34.708118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64424a75-7496-423d-9820-28e349e516c6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:34.731731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 307/606] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:54:34 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/a2a5d7aee47e43e9904a93c6ce3bb412/roles/ced991a120aa41709516ad31b1c57a89 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:34.733129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fde69-2f6b-4645-a9df-72c52f4d742e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.733473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fde69-2f6b-4645-a9df-72c52f4d742e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.733758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fde69-2f6b-4645-a9df-72c52f4d742e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.735456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 308/607] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:34.736938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa721f-56e6-4337-9c88-a64ed98036d4 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.737482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa721f-56e6-4337-9c88-a64ed98036d4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.737768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa721f-56e6-4337-9c88-a64ed98036d4 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.739531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 309/608] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:54:34.740875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd420b-141f-4a34-a5d6-07b1567df8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:34.741865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd420b-141f-4a34-a5d6-07b1567df8d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.742212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd420b-141f-4a34-a5d6-07b1567df8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.742562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd420b-141f-4a34-a5d6-07b1567df8d0 None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/a26055489c284bcf8f0d418e4afffe73/roles/ced991a120aa41709516ad31b1c57a89` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.747322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a5ab9-050c-42a9-8142-09b7b0d9fb20 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.747577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a5ab9-050c-42a9-8142-09b7b0d9fb20 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.748380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a5ab9-050c-42a9-8142-09b7b0d9fb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.765035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd420b-141f-4a34-a5d6-07b1567df8d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=a26055489c284bcf8f0d418e4afffe73, role_id=ced991a120aa41709516ad31b1c57a89)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:34.766654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd420b-141f-4a34-a5d6-07b1567df8d0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:34.777366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7a1a5ab9-050c-42a9-8142-09b7b0d9fb20 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:34.778616 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7a1a5ab9-050c-42a9-8142-09b7b0d9fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:34.783799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 300/609] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:54:34 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/a26055489c284bcf8f0d418e4afffe73/roles/ced991a120aa41709516ad31b1c57a89 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:34.785305 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bf909-6638-4072-ac48-29a3359fb4e0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:34.785694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bf909-6638-4072-ac48-29a3359fb4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:34.785981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bf909-6638-4072-ac48-29a3359fb4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:34.805211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b40bf909-6638-4072-ac48-29a3359fb4e0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:34.806620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b40bf909-6638-4072-ac48-29a3359fb4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:34.898971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 301/610] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:34.926868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 310/611] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:34.930982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bf909-6638-4072-ac48-29a3359fb4e0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:34.965219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a5ab9-050c-42a9-8142-09b7b0d9fb20 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:35.013742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:35.035509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:35.064699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bf909-6638-4072-ac48-29a3359fb4e0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:35.110000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5eea7-ba66-4675-84be-0dafb11c9958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:35.110488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a5ab9-050c-42a9-8142-09b7b0d9fb20 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:35.110838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5eea7-ba66-4675-84be-0dafb11c9958 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:35.111126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5eea7-ba66-4675-84be-0dafb11c9958 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:35.111405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5eea7-ba66-4675-84be-0dafb11c9958 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:35.124952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5eea7-ba66-4675-84be-0dafb11c9958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-a0d5eea7-ba66-4675-84be-0dafb11c9958 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:35.132919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:35.134136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:35.135917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 302/612] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:35.144794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5eea7-ba66-4675-84be-0dafb11c9958 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:35.173107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c68125-7a33-4640-a245-ba002dadc260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:35.174267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68125-7a33-4640-a245-ba002dadc260 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:35.176291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68125-7a33-4640-a245-ba002dadc260 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:35.176780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68125-7a33-4640-a245-ba002dadc260 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:35.201428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c68125-7a33-4640-a245-ba002dadc260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-22c68125-7a33-4640-a245-ba002dadc260 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:35.216826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:35.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:35.218740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:35.222098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 311/613] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:35.227499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c68125-7a33-4640-a245-ba002dadc260 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:35.373488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5eea7-ba66-4675-84be-0dafb11c9958 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:35.390416 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c68125-7a33-4640-a245-ba002dadc260 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:35.424989 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:35.432619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af46489-3e72-4af2-bcc6-49cd5cab9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:35.433577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af46489-3e72-4af2-bcc6-49cd5cab9fce None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:35.434068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af46489-3e72-4af2-bcc6-49cd5cab9fce None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:35.434547 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af46489-3e72-4af2-bcc6-49cd5cab9fce None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:35.435694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af46489-3e72-4af2-bcc6-49cd5cab9fce None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:35.436329 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af46489-3e72-4af2-bcc6-49cd5cab9fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:35.437939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af46489-3e72-4af2-bcc6-49cd5cab9fce None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:35.448975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 312/614] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:35.454880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af46489-3e72-4af2-bcc6-49cd5cab9fce None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:35.467698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:35.474482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3b7af-fc90-428c-bf83-19bac38854ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:35.475184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3b7af-fc90-428c-bf83-19bac38854ab None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:35.475467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3b7af-fc90-428c-bf83-19bac38854ab None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:35.475743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3b7af-fc90-428c-bf83-19bac38854ab None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:35.476497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3b7af-fc90-428c-bf83-19bac38854ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:35.476814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3b7af-fc90-428c-bf83-19bac38854ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:35.478194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3b7af-fc90-428c-bf83-19bac38854ab None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:35.493806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 303/615] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:35.500306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3b7af-fc90-428c-bf83-19bac38854ab None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:35.636939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3b7af-fc90-428c-bf83-19bac38854ab None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:35.677065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445e3f-16ce-445e-a3bd-c8b4e11fd255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:35.678207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445e3f-16ce-445e-a3bd-c8b4e11fd255 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:35.678733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445e3f-16ce-445e-a3bd-c8b4e11fd255 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:35.679253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445e3f-16ce-445e-a3bd-c8b4e11fd255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:35.693718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9445e3f-16ce-445e-a3bd-c8b4e11fd255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:35.695532 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9445e3f-16ce-445e-a3bd-c8b4e11fd255 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:35.710915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af46489-3e72-4af2-bcc6-49cd5cab9fce None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b9445e3f-16ce-445e-a3bd-c8b4e11fd255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:35.716779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:35.717662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:35.718552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:35.718552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:35.718552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:35.718552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:35.720776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 304/616] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:35.727631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445e3f-16ce-445e-a3bd-c8b4e11fd255 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:35.779382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a464d-6016-4c48-ad1b-1c2b90e3ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:35.780173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a464d-6016-4c48-ad1b-1c2b90e3ddff None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:35.780453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a464d-6016-4c48-ad1b-1c2b90e3ddff None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:35.780725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a464d-6016-4c48-ad1b-1c2b90e3ddff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:35.800651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a464d-6016-4c48-ad1b-1c2b90e3ddff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:35.802093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a464d-6016-4c48-ad1b-1c2b90e3ddff None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:35.817867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-342a464d-6016-4c48-ad1b-1c2b90e3ddff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:35.832123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:35.833055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:35.833949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:35.833949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:35.833949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:35.833949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:35.833949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 313/617] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:35.842031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a464d-6016-4c48-ad1b-1c2b90e3ddff None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:35.891198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:35.893279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445e3f-16ce-445e-a3bd-c8b4e11fd255 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:35.929070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c5b6-797b-44da-bca8-c08c65379d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:35.930073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c5b6-797b-44da-bca8-c08c65379d4e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:35.930579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c5b6-797b-44da-bca8-c08c65379d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:35.931120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c5b6-797b-44da-bca8-c08c65379d4e None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:35.932580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809c5b6-797b-44da-bca8-c08c65379d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:35.933098 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809c5b6-797b-44da-bca8-c08c65379d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:35.934674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809c5b6-797b-44da-bca8-c08c65379d4e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:35.948201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 305/618] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:35.953250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c5b6-797b-44da-bca8-c08c65379d4e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:36.054915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a464d-6016-4c48-ad1b-1c2b90e3ddff None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:36.099991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c5b6-797b-44da-bca8-c08c65379d4e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:36.120767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef052477-462f-45ab-a424-cd7d937dcc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:36.121765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef052477-462f-45ab-a424-cd7d937dcc4c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:36.122489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef052477-462f-45ab-a424-cd7d937dcc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:36.122999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef052477-462f-45ab-a424-cd7d937dcc4c None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:36.123121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:36.124048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef052477-462f-45ab-a424-cd7d937dcc4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:36.125026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef052477-462f-45ab-a424-cd7d937dcc4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:36.127283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef052477-462f-45ab-a424-cd7d937dcc4c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:36.140722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 314/619] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:36.146381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef052477-462f-45ab-a424-cd7d937dcc4c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:36.168698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfadda-7b06-4ea0-b6d5-0d4ed203e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:36.169840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfadda-7b06-4ea0-b6d5-0d4ed203e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:36.170329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfadda-7b06-4ea0-b6d5-0d4ed203e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:36.170853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfadda-7b06-4ea0-b6d5-0d4ed203e3e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:36.181660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfadda-7b06-4ea0-b6d5-0d4ed203e3e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:36.184710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfadda-7b06-4ea0-b6d5-0d4ed203e3e0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-36dfadda-7b06-4ea0-b6d5-0d4ed203e3e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:36.207643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:36.208643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:36.209600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:36.209600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:36.209600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:36.209600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:36.209600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:36.209600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:36.209600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:36.209600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:36.209600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:36.209600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:36.220176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 306/620] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:36.225690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfadda-7b06-4ea0-b6d5-0d4ed203e3e0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:36.327076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:36.349530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef052477-462f-45ab-a424-cd7d937dcc4c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:36.425579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfadda-7b06-4ea0-b6d5-0d4ed203e3e0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:36.428219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2b5fd-a899-4b20-a016-7599343f2e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:36.429012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2b5fd-a899-4b20-a016-7599343f2e03 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:36.429296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2b5fd-a899-4b20-a016-7599343f2e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:36.429572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2b5fd-a899-4b20-a016-7599343f2e03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:36.445719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2b5fd-a899-4b20-a016-7599343f2e03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:36.447673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2b5fd-a899-4b20-a016-7599343f2e03 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-81b2b5fd-a899-4b20-a016-7599343f2e03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:36.469711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:36.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:36.471669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:36.471669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:36.471669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:36.471669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:36.471669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:36.471669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:36.471669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:36.471669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:36.471669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:36.471669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:36.481317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 315/621] 10.222.0.30 () {56 vars in 1093 bytes} [Mon May 23 17:54:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:36.485608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2b5fd-a899-4b20-a016-7599343f2e03 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:36.497237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88415f45-505a-47ba-baba-6968908c4ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:36.497918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88415f45-505a-47ba-baba-6968908c4ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:36.498204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88415f45-505a-47ba-baba-6968908c4ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:36.498483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88415f45-505a-47ba-baba-6968908c4ba2 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:36.499370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88415f45-505a-47ba-baba-6968908c4ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:36.499684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88415f45-505a-47ba-baba-6968908c4ba2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:36.501147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88415f45-505a-47ba-baba-6968908c4ba2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:36.520953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 307/622] 10.222.0.30 () {56 vars in 1135 bytes} [Mon May 23 17:54:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:36.529221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88415f45-505a-47ba-baba-6968908c4ba2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:36.563096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:36.634072 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88415f45-505a-47ba-baba-6968908c4ba2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:36.670728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c625087-6b63-4e83-be5c-bb83b05bb8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:36.671742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c625087-6b63-4e83-be5c-bb83b05bb8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:36.672145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c625087-6b63-4e83-be5c-bb83b05bb8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:36.672534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c625087-6b63-4e83-be5c-bb83b05bb8f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:36.676812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2b5fd-a899-4b20-a016-7599343f2e03 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:36.685289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c625087-6b63-4e83-be5c-bb83b05bb8f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:36.686942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c625087-6b63-4e83-be5c-bb83b05bb8f8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-8c625087-6b63-4e83-be5c-bb83b05bb8f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:36.708922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:36.709869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:36.710889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:36.710889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:36.710889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:36.710889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:36.712605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 308/623] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:36.717838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c625087-6b63-4e83-be5c-bb83b05bb8f8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:36.753583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ab28b-9b59-418d-9f25-4d90599a0cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:36.754263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ab28b-9b59-418d-9f25-4d90599a0cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:36.754550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ab28b-9b59-418d-9f25-4d90599a0cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:36.754859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ab28b-9b59-418d-9f25-4d90599a0cf5 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:36.755703 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ab28b-9b59-418d-9f25-4d90599a0cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:36.756015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ab28b-9b59-418d-9f25-4d90599a0cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:36.757464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ab28b-9b59-418d-9f25-4d90599a0cf5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:36.778020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 316/624] 10.222.0.30 () {56 vars in 1133 bytes} [Mon May 23 17:54:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:36.783162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ab28b-9b59-418d-9f25-4d90599a0cf5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:36.786536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:36.910113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ab28b-9b59-418d-9f25-4d90599a0cf5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:36.955538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34733e-ef0e-4856-aa19-46ec6d5f0972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:36.956778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34733e-ef0e-4856-aa19-46ec6d5f0972 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:36.957064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34733e-ef0e-4856-aa19-46ec6d5f0972 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:36.957340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34733e-ef0e-4856-aa19-46ec6d5f0972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:36.960685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:37.033429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c625087-6b63-4e83-be5c-bb83b05bb8f8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:37.041597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34733e-ef0e-4856-aa19-46ec6d5f0972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:37.043044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34733e-ef0e-4856-aa19-46ec6d5f0972 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:37.044994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:37.144968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c8657-6299-4e7a-a50e-f4421913b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:37.145643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c8657-6299-4e7a-a50e-f4421913b703 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.145927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c8657-6299-4e7a-a50e-f4421913b703 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.146204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c8657-6299-4e7a-a50e-f4421913b703 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.146969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c8657-6299-4e7a-a50e-f4421913b703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:37.147282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c8657-6299-4e7a-a50e-f4421913b703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:37.148662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c8657-6299-4e7a-a50e-f4421913b703 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:37.162899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 309/625] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:37.168350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c8657-6299-4e7a-a50e-f4421913b703 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:37.182824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 317/626] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:37.185717 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347954-857b-455e-9d9e-d8d63bca9dbe None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.186039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347954-857b-455e-9d9e-d8d63bca9dbe None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.186320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7347954-857b-455e-9d9e-d8d63bca9dbe None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.193028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 318/627] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:37.193865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347954-857b-455e-9d9e-d8d63bca9dbe None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:37.302569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c8657-6299-4e7a-a50e-f4421913b703 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:37.337400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7347954-857b-455e-9d9e-d8d63bca9dbe None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:37.339217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0cf34-3242-43ae-8537-dfa8b21960d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:37.339724 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:37.340025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0cf34-3242-43ae-8537-dfa8b21960d2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.340310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0cf34-3242-43ae-8537-dfa8b21960d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.340959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0cf34-3242-43ae-8537-dfa8b21960d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.344921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:37.350349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0cf34-3242-43ae-8537-dfa8b21960d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:37.352584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0cf34-3242-43ae-8537-dfa8b21960d2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c8a0cf34-3242-43ae-8537-dfa8b21960d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:37.372135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:37.373257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:37.374414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:37.374414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:37.374414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:37.374414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:37.374414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:37.374414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:37.374414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:37.374414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:37.376849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 310/628] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:37.378763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402719a-c7a8-4851-b69a-940d45a2e7e5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.379205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402719a-c7a8-4851-b69a-940d45a2e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.379786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402719a-c7a8-4851-b69a-940d45a2e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.383928 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43dd72-ead8-4b93-ad25-6abb7ee4ece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:37.385533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43dd72-ead8-4b93-ad25-6abb7ee4ece4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.386071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43dd72-ead8-4b93-ad25-6abb7ee4ece4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.386689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43dd72-ead8-4b93-ad25-6abb7ee4ece4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.399145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43dd72-ead8-4b93-ad25-6abb7ee4ece4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:37.400268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e402719a-c7a8-4851-b69a-940d45a2e7e5 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:37.401132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43dd72-ead8-4b93-ad25-6abb7ee4ece4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:37.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e402719a-c7a8-4851-b69a-940d45a2e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-4a43dd72-ead8-4b93-ad25-6abb7ee4ece4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:37.423705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:37.424700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:37.425592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:37.425592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:37.425592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:37.425592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:37.425592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 319/629] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:37.427566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43dd72-ead8-4b93-ad25-6abb7ee4ece4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:37.481279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 311/630] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:37.482604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01d25-29b6-4ce1-ad17-0dcebac91b3f None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.482922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01d25-29b6-4ce1-ad17-0dcebac91b3f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.483204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01d25-29b6-4ce1-ad17-0dcebac91b3f None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.486738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 312/631] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:37.486738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c01d25-29b6-4ce1-ad17-0dcebac91b3f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:37.538326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43dd72-ead8-4b93-ad25-6abb7ee4ece4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:37.575653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7b150-bc57-46e6-a05c-dfaa2726b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:37.576232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7b150-bc57-46e6-a05c-dfaa2726b263 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.576517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7b150-bc57-46e6-a05c-dfaa2726b263 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.576804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7b150-bc57-46e6-a05c-dfaa2726b263 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.577584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7b150-bc57-46e6-a05c-dfaa2726b263 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:37.577896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7b150-bc57-46e6-a05c-dfaa2726b263 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:37.579379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7b150-bc57-46e6-a05c-dfaa2726b263 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:37.591057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 320/632] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:37.592408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c772144-df9c-4173-9fb4-cf961cd27136 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.592696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c772144-df9c-4173-9fb4-cf961cd27136 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.592975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c772144-df9c-4173-9fb4-cf961cd27136 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.594437 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 321/633] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:37.595656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575cd8-e98b-4357-983d-bb4e761200bf None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.595768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575cd8-e98b-4357-983d-bb4e761200bf None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.595960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575cd8-e98b-4357-983d-bb4e761200bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.599687 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c01d25-29b6-4ce1-ad17-0dcebac91b3f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:37.612262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-83575cd8-e98b-4357-983d-bb4e761200bf None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:37.613461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-83575cd8-e98b-4357-983d-bb4e761200bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:37.623613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:37.627005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:37.637105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d17ebe-02cf-4a86-a481-eb67e679fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:37.637425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d17ebe-02cf-4a86-a481-eb67e679fc45 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.637709 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d17ebe-02cf-4a86-a481-eb67e679fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.637994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d17ebe-02cf-4a86-a481-eb67e679fc45 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.638723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d17ebe-02cf-4a86-a481-eb67e679fc45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:37.639052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d17ebe-02cf-4a86-a481-eb67e679fc45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:37.640420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d17ebe-02cf-4a86-a481-eb67e679fc45 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:37.652294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 313/634] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:37.653123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d17ebe-02cf-4a86-a481-eb67e679fc45 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:37.688246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 322/635] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:37.689069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575cd8-e98b-4357-983d-bb4e761200bf None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:37.764967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d17ebe-02cf-4a86-a481-eb67e679fc45 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:37.794018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575cd8-e98b-4357-983d-bb4e761200bf None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:37.798293 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7326b-c4e1-4870-9801-be8f498c5bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:37.799124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7326b-c4e1-4870-9801-be8f498c5bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.799414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7326b-c4e1-4870-9801-be8f498c5bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.799695 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7326b-c4e1-4870-9801-be8f498c5bc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.810192 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7326b-c4e1-4870-9801-be8f498c5bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-bba7326b-c4e1-4870-9801-be8f498c5bc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:37.817928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:37.818917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:37.819791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 314/636] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:37.821793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690acf5-de95-4dbe-85a6-807986f1c7b6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.822129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690acf5-de95-4dbe-85a6-807986f1c7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.822417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690acf5-de95-4dbe-85a6-807986f1c7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.829877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520816a-fd07-45f1-8002-98227d6390c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:37.830692 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520816a-fd07-45f1-8002-98227d6390c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:37.830997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520816a-fd07-45f1-8002-98227d6390c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:37.831273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520816a-fd07-45f1-8002-98227d6390c0 None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/fcbd7035e027494cb063489b375cb385/roles/ced991a120aa41709516ad31b1c57a89` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:37.839420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d690acf5-de95-4dbe-85a6-807986f1c7b6 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:37.840606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d690acf5-de95-4dbe-85a6-807986f1c7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:37.845485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520816a-fd07-45f1-8002-98227d6390c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=fcbd7035e027494cb063489b375cb385, role_id=ced991a120aa41709516ad31b1c57a89)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:37.846971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520816a-fd07-45f1-8002-98227d6390c0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:37.849136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:37.860522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 323/637] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:54:37 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/fcbd7035e027494cb063489b375cb385/roles/ced991a120aa41709516ad31b1c57a89 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:37.861469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520816a-fd07-45f1-8002-98227d6390c0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:37.886211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:37.916795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 315/638] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:37.917968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690acf5-de95-4dbe-85a6-807986f1c7b6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.015532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520816a-fd07-45f1-8002-98227d6390c0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.039150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690acf5-de95-4dbe-85a6-807986f1c7b6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.060335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37713df8-fe51-41de-85ae-416c776343a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.061136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37713df8-fe51-41de-85ae-416c776343a4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.061418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37713df8-fe51-41de-85ae-416c776343a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.061691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37713df8-fe51-41de-85ae-416c776343a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.071842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37713df8-fe51-41de-85ae-416c776343a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:38.073940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37713df8-fe51-41de-85ae-416c776343a4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:38.081649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9acad8-908f-4fa6-8bd6-4194ecaa93db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.082389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9acad8-908f-4fa6-8bd6-4194ecaa93db None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.082674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9acad8-908f-4fa6-8bd6-4194ecaa93db None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.082987 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9acad8-908f-4fa6-8bd6-4194ecaa93db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-37713df8-fe51-41de-85ae-416c776343a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:38.089515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:38.090385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:38.091315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:38.091315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:38.091315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:38.091315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:38.091315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:38.091315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:38.091315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:38.091315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:38.091315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 324/639] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:38.091897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37713df8-fe51-41de-85ae-416c776343a4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.099467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9acad8-908f-4fa6-8bd6-4194ecaa93db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ea9acad8-908f-4fa6-8bd6-4194ecaa93db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:38.108453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:38.109385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:38.110231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 316/640] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:38.110963 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9acad8-908f-4fa6-8bd6-4194ecaa93db None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.153947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:38.161367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:38.214220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37713df8-fe51-41de-85ae-416c776343a4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.233998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9acad8-908f-4fa6-8bd6-4194ecaa93db None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.249978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcab64-ad18-4e18-afe4-15810396ff19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.250645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcab64-ad18-4e18-afe4-15810396ff19 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.251016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcab64-ad18-4e18-afe4-15810396ff19 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.251245 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcab64-ad18-4e18-afe4-15810396ff19 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.252208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcab64-ad18-4e18-afe4-15810396ff19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:38.252315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcab64-ad18-4e18-afe4-15810396ff19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:38.253648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcab64-ad18-4e18-afe4-15810396ff19 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:38.262566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 325/641] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:38.263415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcab64-ad18-4e18-afe4-15810396ff19 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.274998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0da86e-178e-49a5-866b-16dd719c211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.276325 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0da86e-178e-49a5-866b-16dd719c211b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.276609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0da86e-178e-49a5-866b-16dd719c211b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.276890 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0da86e-178e-49a5-866b-16dd719c211b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.288001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0da86e-178e-49a5-866b-16dd719c211b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-9d0da86e-178e-49a5-866b-16dd719c211b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:38.296330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:38.297330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:38.298182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 317/642] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:38.299731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0da86e-178e-49a5-866b-16dd719c211b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.379397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcab64-ad18-4e18-afe4-15810396ff19 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.396303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:38.397092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:38.404256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0da86e-178e-49a5-866b-16dd719c211b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.418867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72737b22-bc74-49d1-b212-c221bdc38e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.419620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737b22-bc74-49d1-b212-c221bdc38e45 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.419914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737b22-bc74-49d1-b212-c221bdc38e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.420205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737b22-bc74-49d1-b212-c221bdc38e45 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.420987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737b22-bc74-49d1-b212-c221bdc38e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:38.421299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737b22-bc74-49d1-b212-c221bdc38e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:38.422815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737b22-bc74-49d1-b212-c221bdc38e45 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:38.439973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 326/643] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:38.439973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72737b22-bc74-49d1-b212-c221bdc38e45 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.445461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a3ab-7480-4c55-96aa-c27543b146cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.446146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a3ab-7480-4c55-96aa-c27543b146cd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.446431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a3ab-7480-4c55-96aa-c27543b146cd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.446726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a3ab-7480-4c55-96aa-c27543b146cd None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.448113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a3ab-7480-4c55-96aa-c27543b146cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:38.448512 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a3ab-7480-4c55-96aa-c27543b146cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:38.449888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a3ab-7480-4c55-96aa-c27543b146cd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:38.458417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 318/644] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:38.459113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a3ab-7480-4c55-96aa-c27543b146cd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.556458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72737b22-bc74-49d1-b212-c221bdc38e45 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.565807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a3ab-7480-4c55-96aa-c27543b146cd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.596348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2baeb-cfac-4819-a457-479d5b19c1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.597249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2baeb-cfac-4819-a457-479d5b19c1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.597606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2baeb-cfac-4819-a457-479d5b19c1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.597963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2baeb-cfac-4819-a457-479d5b19c1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.602823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c341812-38f6-4c41-b742-5f51d98657d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.603527 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c341812-38f6-4c41-b742-5f51d98657d6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.603852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c341812-38f6-4c41-b742-5f51d98657d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.604144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c341812-38f6-4c41-b742-5f51d98657d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.604892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c341812-38f6-4c41-b742-5f51d98657d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:38.605524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c341812-38f6-4c41-b742-5f51d98657d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:38.606568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c341812-38f6-4c41-b742-5f51d98657d6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:38.609303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2baeb-cfac-4819-a457-479d5b19c1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:38.611130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2baeb-cfac-4819-a457-479d5b19c1a0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:38.620651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 319/645] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:38.621268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c341812-38f6-4c41-b742-5f51d98657d6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-16b2baeb-cfac-4819-a457-479d5b19c1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:38.631814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:38.632891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:38.635681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:38.635681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:38.635681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:38.635681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:38.635681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 327/646] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:38.639463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2baeb-cfac-4819-a457-479d5b19c1a0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.648409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:38.668678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:38.739690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c341812-38f6-4c41-b742-5f51d98657d6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.750973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2baeb-cfac-4819-a457-479d5b19c1a0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.777693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd1e5c-1e5a-4f4d-b9c2-c4bc076a450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.778503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd1e5c-1e5a-4f4d-b9c2-c4bc076a450b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.778934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd1e5c-1e5a-4f4d-b9c2-c4bc076a450b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.779312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd1e5c-1e5a-4f4d-b9c2-c4bc076a450b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.780244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd1e5c-1e5a-4f4d-b9c2-c4bc076a450b None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=9021e2249e11489083139e210562ce44) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:38.780663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd1e5c-1e5a-4f4d-b9c2-c4bc076a450b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:38.782229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd1e5c-1e5a-4f4d-b9c2-c4bc076a450b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:38.786594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b40ef9-15c5-440a-b05e-8da30485c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.787439 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b40ef9-15c5-440a-b05e-8da30485c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.787721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b40ef9-15c5-440a-b05e-8da30485c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.787994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b40ef9-15c5-440a-b05e-8da30485c4c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.788693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 320/647] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:38 2022] GET /identity/v3/role_assignments?user.id=9021e2249e11489083139e210562ce44&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:38.789568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd1e5c-1e5a-4f4d-b9c2-c4bc076a450b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.810507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b40ef9-15c5-440a-b05e-8da30485c4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:38.812372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b40ef9-15c5-440a-b05e-8da30485c4c9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-a8b40ef9-15c5-440a-b05e-8da30485c4c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:38.837292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:38.839239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:38.840135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:38.840135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:38.840135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:38.840135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:38.842850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 328/648] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:38.843974 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b40ef9-15c5-440a-b05e-8da30485c4c9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:38.906667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:38.926312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd1e5c-1e5a-4f4d-b9c2-c4bc076a450b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:38.968509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:38.971184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f98f2-0011-4819-a6bb-9b573a10f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:38.972375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f98f2-0011-4819-a6bb-9b573a10f3fb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:38.972830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f98f2-0011-4819-a6bb-9b573a10f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:38.973529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f98f2-0011-4819-a6bb-9b573a10f3fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:38.988815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f98f2-0011-4819-a6bb-9b573a10f3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:38.990732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f98f2-0011-4819-a6bb-9b573a10f3fb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:38.992235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b40ef9-15c5-440a-b05e-8da30485c4c9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ea4f98f2-0011-4819-a6bb-9b573a10f3fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:39.011383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:39.012345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:39.013249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:39.013249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:39.013249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:39.013249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:39.015535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 321/649] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:39.016594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f98f2-0011-4819-a6bb-9b573a10f3fb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:39.033094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608583ab-ff65-4c51-ac9e-855418dccb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.033760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608583ab-ff65-4c51-ac9e-855418dccb18 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.034047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608583ab-ff65-4c51-ac9e-855418dccb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.034327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608583ab-ff65-4c51-ac9e-855418dccb18 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:39.035075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608583ab-ff65-4c51-ac9e-855418dccb18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:39.035410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608583ab-ff65-4c51-ac9e-855418dccb18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:39.036755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608583ab-ff65-4c51-ac9e-855418dccb18 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:39.050220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 329/650] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:39.051694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608583ab-ff65-4c51-ac9e-855418dccb18 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:39.153928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f98f2-0011-4819-a6bb-9b573a10f3fb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.174746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608583ab-ff65-4c51-ac9e-855418dccb18 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.190843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7833b5-40e6-49a9-8cd1-db43e9cb02f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.191747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7833b5-40e6-49a9-8cd1-db43e9cb02f3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.192105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7833b5-40e6-49a9-8cd1-db43e9cb02f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.192555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7833b5-40e6-49a9-8cd1-db43e9cb02f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:39.193350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7833b5-40e6-49a9-8cd1-db43e9cb02f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:39.193728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7833b5-40e6-49a9-8cd1-db43e9cb02f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:39.195297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7833b5-40e6-49a9-8cd1-db43e9cb02f3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:39.198655 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:39.210592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 322/651] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:39.211121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2325e4-d8f8-405c-8c2e-78d479820e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.211450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7833b5-40e6-49a9-8cd1-db43e9cb02f3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:39.214773 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2325e4-d8f8-405c-8c2e-78d479820e29 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.215111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2325e4-d8f8-405c-8c2e-78d479820e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.215393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2325e4-d8f8-405c-8c2e-78d479820e29 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:39.216143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2325e4-d8f8-405c-8c2e-78d479820e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:39.216635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2325e4-d8f8-405c-8c2e-78d479820e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:39.218058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2325e4-d8f8-405c-8c2e-78d479820e29 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:39.232813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:39.242734 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 330/652] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:39.243989 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2325e4-d8f8-405c-8c2e-78d479820e29 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:39.335793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7833b5-40e6-49a9-8cd1-db43e9cb02f3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.352816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2325e4-d8f8-405c-8c2e-78d479820e29 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.372734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8437d-f717-450e-b372-1cd6ac096ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.373546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8437d-f717-450e-b372-1cd6ac096ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.373826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8437d-f717-450e-b372-1cd6ac096ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.374099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8437d-f717-450e-b372-1cd6ac096ab8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:39.381877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8437d-f717-450e-b372-1cd6ac096ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:39.383774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8437d-f717-450e-b372-1cd6ac096ab8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:39.391422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33d7a-3d57-4592-9e20-2c7ddcef01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.392603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33d7a-3d57-4592-9e20-2c7ddcef01d8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.393100 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33d7a-3d57-4592-9e20-2c7ddcef01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.393601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33d7a-3d57-4592-9e20-2c7ddcef01d8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-dff8437d-f717-450e-b372-1cd6ac096ab8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:39.399957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:39.401592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:39.402558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 323/653] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:39.403298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8437d-f717-450e-b372-1cd6ac096ab8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:39.405413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d33d7a-3d57-4592-9e20-2c7ddcef01d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:39.407417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d33d7a-3d57-4592-9e20-2c7ddcef01d8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-97d33d7a-3d57-4592-9e20-2c7ddcef01d8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:39.423202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:39.424241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:39.425242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:39.425242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:39.425242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:39.425242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:39.425242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:39.425242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:39.425242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:39.425242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:39.425242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 17:54:39.425242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:39.432493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 331/654] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:39.433634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33d7a-3d57-4592-9e20-2c7ddcef01d8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:39.467074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:39.500275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:39.516998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8437d-f717-450e-b372-1cd6ac096ab8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.557305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33d7a-3d57-4592-9e20-2c7ddcef01d8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.560415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b03cca-4fc2-4514-b70f-c839c8c79dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.562102 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b03cca-4fc2-4514-b70f-c839c8c79dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.562392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b03cca-4fc2-4514-b70f-c839c8c79dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.562668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b03cca-4fc2-4514-b70f-c839c8c79dd4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:39.571567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b03cca-4fc2-4514-b70f-c839c8c79dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:39.573917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b03cca-4fc2-4514-b70f-c839c8c79dd4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-a4b03cca-4fc2-4514-b70f-c839c8c79dd4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:39.594876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:39.595881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:39.596816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 324/655] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:39.597439 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b03cca-4fc2-4514-b70f-c839c8c79dd4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:39.605442 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2b9fa-c460-4255-a2e2-1d2e93ab64f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.606438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b9fa-c460-4255-a2e2-1d2e93ab64f4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.607005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b9fa-c460-4255-a2e2-1d2e93ab64f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.607503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b9fa-c460-4255-a2e2-1d2e93ab64f4 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:39.608559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2b9fa-c460-4255-a2e2-1d2e93ab64f4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:39.609083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2b9fa-c460-4255-a2e2-1d2e93ab64f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:39.610811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2b9fa-c460-4255-a2e2-1d2e93ab64f4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:39.630486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 332/656] 10.222.0.30 () {56 vars in 1137 bytes} [Mon May 23 17:54:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:39.631492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2b9fa-c460-4255-a2e2-1d2e93ab64f4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:39.720173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b03cca-4fc2-4514-b70f-c839c8c79dd4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.740478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2b9fa-c460-4255-a2e2-1d2e93ab64f4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.755158 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:39.759307 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863bd58-81f5-45bf-9f70-cb16bbf7969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.760547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863bd58-81f5-45bf-9f70-cb16bbf7969e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.760980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863bd58-81f5-45bf-9f70-cb16bbf7969e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.761399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863bd58-81f5-45bf-9f70-cb16bbf7969e None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:39.761682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:39.763016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863bd58-81f5-45bf-9f70-cb16bbf7969e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:39.763502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863bd58-81f5-45bf-9f70-cb16bbf7969e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:39.765112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863bd58-81f5-45bf-9f70-cb16bbf7969e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:39.782819 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afdb83-00e2-4379-bd52-90a1acb97f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.784026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afdb83-00e2-4379-bd52-90a1acb97f66 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.784026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afdb83-00e2-4379-bd52-90a1acb97f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.784435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afdb83-00e2-4379-bd52-90a1acb97f66 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:39.785440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afdb83-00e2-4379-bd52-90a1acb97f66 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:39.785851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afdb83-00e2-4379-bd52-90a1acb97f66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:39.787417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afdb83-00e2-4379-bd52-90a1acb97f66 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:39.788532 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 325/657] 10.222.0.30 () {56 vars in 1137 bytes} [Mon May 23 17:54:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:39.789604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863bd58-81f5-45bf-9f70-cb16bbf7969e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:39.816698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 333/658] 10.222.0.30 () {56 vars in 1139 bytes} [Mon May 23 17:54:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:39.817739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afdb83-00e2-4379-bd52-90a1acb97f66 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:39.911468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863bd58-81f5-45bf-9f70-cb16bbf7969e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.949752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afdb83-00e2-4379-bd52-90a1acb97f66 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:39.962606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca292a-0714-4370-98e6-9a0827f59482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.963650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca292a-0714-4370-98e6-9a0827f59482 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.964089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca292a-0714-4370-98e6-9a0827f59482 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.964642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca292a-0714-4370-98e6-9a0827f59482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:39.989940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5ba11-6a29-4370-9da1-c2ce494f17d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:39.990952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5ba11-6a29-4370-9da1-c2ce494f17d6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:39.991445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5ba11-6a29-4370-9da1-c2ce494f17d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:39.992019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5ba11-6a29-4370-9da1-c2ce494f17d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:40.017815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:40.047318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca292a-0714-4370-98e6-9a0827f59482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:40.049033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca292a-0714-4370-98e6-9a0827f59482 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:40.055933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:40.086419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5ba11-6a29-4370-9da1-c2ce494f17d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:40.088761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5ba11-6a29-4370-9da1-c2ce494f17d6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:40.178961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 326/659] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:40.179807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca292a-0714-4370-98e6-9a0827f59482 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:40.209270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 334/660] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:40.210821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf74633-5fbe-42d4-bea2-5ee7b1d25864 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:40.211119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf74633-5fbe-42d4-bea2-5ee7b1d25864 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:40.211401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf74633-5fbe-42d4-bea2-5ee7b1d25864 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:40.215536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 335/661] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:40.215536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf74633-5fbe-42d4-bea2-5ee7b1d25864 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:40.255260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:40.283104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca292a-0714-4370-98e6-9a0827f59482 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:40.304145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:40.321077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a52f8-c392-4c58-ac9d-f9f36dd26972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:40.321805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a52f8-c392-4c58-ac9d-f9f36dd26972 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:40.323109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a52f8-c392-4c58-ac9d-f9f36dd26972 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:40.323393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a52f8-c392-4c58-ac9d-f9f36dd26972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:40.330516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf74633-5fbe-42d4-bea2-5ee7b1d25864 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:40.366191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829af89-0f06-4c03-9b2e-30215dded414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:40.367326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829af89-0f06-4c03-9b2e-30215dded414 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:40.367778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829af89-0f06-4c03-9b2e-30215dded414 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:40.368056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829af89-0f06-4c03-9b2e-30215dded414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:40.378985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829af89-0f06-4c03-9b2e-30215dded414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:40.380428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829af89-0f06-4c03-9b2e-30215dded414 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:40.392799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a52f8-c392-4c58-ac9d-f9f36dd26972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:40.394246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a52f8-c392-4c58-ac9d-f9f36dd26972 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-8829af89-0f06-4c03-9b2e-30215dded414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:40.399094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:40.400469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:40.401475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:40.401475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:40.401475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:40.401475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:40.405638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 336/662] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:40.406310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829af89-0f06-4c03-9b2e-30215dded414 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:40.473080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:40.506480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 327/663] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:40.506480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b3c0-28f9-433a-aa9d-78022822e26a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:40.506480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b3c0-28f9-433a-aa9d-78022822e26a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:40.506480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b3c0-28f9-433a-aa9d-78022822e26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:40.519584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829af89-0f06-4c03-9b2e-30215dded414 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:40.529245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3648b3c0-28f9-433a-aa9d-78022822e26a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:40.530832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3648b3c0-28f9-433a-aa9d-78022822e26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:40.547337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:40.556812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0d6cc-0bf7-4e72-83a3-d59b9b56f7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:40.557702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d6cc-0bf7-4e72-83a3-d59b9b56f7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:40.558229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d6cc-0bf7-4e72-83a3-d59b9b56f7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:40.558229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d6cc-0bf7-4e72-83a3-d59b9b56f7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:40.568619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0d6cc-0bf7-4e72-83a3-d59b9b56f7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:40.570075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0d6cc-0bf7-4e72-83a3-d59b9b56f7e4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-bcd0d6cc-0bf7-4e72-83a3-d59b9b56f7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:40.589348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:40.590266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:40.591798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:40.591798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:40.591798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:40.591798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:40.591798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 337/664] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:40.591798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0d6cc-0bf7-4e72-83a3-d59b9b56f7e4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:40.614737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 328/665] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:40.614737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b3c0-28f9-433a-aa9d-78022822e26a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:40.707037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0d6cc-0bf7-4e72-83a3-d59b9b56f7e4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:40.718908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b3c0-28f9-433a-aa9d-78022822e26a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:40.721602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:40.744795 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555df7e4-db1b-4f73-a6bc-b6f29d3a692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:40.745459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df7e4-db1b-4f73-a6bc-b6f29d3a692a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:40.745747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df7e4-db1b-4f73-a6bc-b6f29d3a692a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:40.746026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df7e4-db1b-4f73-a6bc-b6f29d3a692a None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:40.746791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555df7e4-db1b-4f73-a6bc-b6f29d3a692a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:40.747100 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555df7e4-db1b-4f73-a6bc-b6f29d3a692a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:40.748476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555df7e4-db1b-4f73-a6bc-b6f29d3a692a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:40.758174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cdb44-0e74-4caa-9fde-db417262ca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:40.759477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cdb44-0e74-4caa-9fde-db417262ca91 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:40.759932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cdb44-0e74-4caa-9fde-db417262ca91 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:40.760237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 338/666] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:40.760642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cdb44-0e74-4caa-9fde-db417262ca91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:40.761054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555df7e4-db1b-4f73-a6bc-b6f29d3a692a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:40.776431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cdb44-0e74-4caa-9fde-db417262ca91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:40.777907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cdb44-0e74-4caa-9fde-db417262ca91 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-872cdb44-0e74-4caa-9fde-db417262ca91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:40.795626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:40.796601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:40.802269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:40.802269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:40.802269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:40.802269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:40.802269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 329/667] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:40.802269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cdb44-0e74-4caa-9fde-db417262ca91 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:40.809037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:40.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555df7e4-db1b-4f73-a6bc-b6f29d3a692a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:40.907953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cdb44-0e74-4caa-9fde-db417262ca91 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:40.908944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e7e1b-d0c0-4ce9-bdf4-d1074606dcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:40.909721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e7e1b-d0c0-4ce9-bdf4-d1074606dcde None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:40.910109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e7e1b-d0c0-4ce9-bdf4-d1074606dcde None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:40.910397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e7e1b-d0c0-4ce9-bdf4-d1074606dcde None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:40.911205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e7e1b-d0c0-4ce9-bdf4-d1074606dcde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:40.911512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e7e1b-d0c0-4ce9-bdf4-d1074606dcde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:40.912919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e7e1b-d0c0-4ce9-bdf4-d1074606dcde None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:40.930022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 339/668] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:40.930022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e7e1b-d0c0-4ce9-bdf4-d1074606dcde None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:40.945301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc758c1-62f0-46e8-a410-def2498f60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:40.946109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc758c1-62f0-46e8-a410-def2498f60a2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:40.946397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc758c1-62f0-46e8-a410-def2498f60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:40.946676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc758c1-62f0-46e8-a410-def2498f60a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:40.958220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc758c1-62f0-46e8-a410-def2498f60a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-9bc758c1-62f0-46e8-a410-def2498f60a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:40.966544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:40.967522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:40.968365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 330/669] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:40.969096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc758c1-62f0-46e8-a410-def2498f60a2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:40.987235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:41.038103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:41.042670 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e7e1b-d0c0-4ce9-bdf4-d1074606dcde None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.079943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc758c1-62f0-46e8-a410-def2498f60a2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.084172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094b75a-94c0-4f11-880d-112885cd84f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.084983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b75a-94c0-4f11-880d-112885cd84f0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.085268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b75a-94c0-4f11-880d-112885cd84f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.085545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b75a-94c0-4f11-880d-112885cd84f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.093156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094b75a-94c0-4f11-880d-112885cd84f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.094622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094b75a-94c0-4f11-880d-112885cd84f0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-d094b75a-94c0-4f11-880d-112885cd84f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:41.108515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:41.109421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:41.110313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:41.110313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:41.110313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:41.110313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:41.110313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:41.110313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:41.110313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:41.110313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:41.110313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 340/670] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:41.111276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094b75a-94c0-4f11-880d-112885cd84f0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:41.124271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1bd64-17e9-4ca0-aaa4-b94d631189f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.124943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1bd64-17e9-4ca0-aaa4-b94d631189f5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.125228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1bd64-17e9-4ca0-aaa4-b94d631189f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.125514 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1bd64-17e9-4ca0-aaa4-b94d631189f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.126244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1bd64-17e9-4ca0-aaa4-b94d631189f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:41.126557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1bd64-17e9-4ca0-aaa4-b94d631189f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.127966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1bd64-17e9-4ca0-aaa4-b94d631189f5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.141164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 331/671] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:41.141995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1bd64-17e9-4ca0-aaa4-b94d631189f5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:41.225736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:41.228702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094b75a-94c0-4f11-880d-112885cd84f0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.250173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1bd64-17e9-4ca0-aaa4-b94d631189f5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.265295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991f59-25fd-4d40-92c2-adbcdb790100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.266084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991f59-25fd-4d40-92c2-adbcdb790100 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.266364 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991f59-25fd-4d40-92c2-adbcdb790100 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.266632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991f59-25fd-4d40-92c2-adbcdb790100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.273165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16991f59-25fd-4d40-92c2-adbcdb790100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.274605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16991f59-25fd-4d40-92c2-adbcdb790100 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.284869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4a1af-0b5e-4bb4-b8f6-d7cbca490cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.285540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4a1af-0b5e-4bb4-b8f6-d7cbca490cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.285827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4a1af-0b5e-4bb4-b8f6-d7cbca490cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.286138 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4a1af-0b5e-4bb4-b8f6-d7cbca490cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.286907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4a1af-0b5e-4bb4-b8f6-d7cbca490cf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:41.287217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4a1af-0b5e-4bb4-b8f6-d7cbca490cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.288618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4a1af-0b5e-4bb4-b8f6-d7cbca490cf2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-16991f59-25fd-4d40-92c2-adbcdb790100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:41.289108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:41.290031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:41.291258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:41.291258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:41.291258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:41.291258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:41.291258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:41.291258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:41.291258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:41.291258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:41.291258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 341/672] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:41.291258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991f59-25fd-4d40-92c2-adbcdb790100 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:41.297895 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 332/673] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:41.298735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4a1af-0b5e-4bb4-b8f6-d7cbca490cf2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:41.312995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:41.391248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991f59-25fd-4d40-92c2-adbcdb790100 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.399323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4a1af-0b5e-4bb4-b8f6-d7cbca490cf2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.425098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04633e20-01f7-4056-8553-756a265947c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.425747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04633e20-01f7-4056-8553-756a265947c1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.426022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04633e20-01f7-4056-8553-756a265947c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.426292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04633e20-01f7-4056-8553-756a265947c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.427102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04633e20-01f7-4056-8553-756a265947c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:41.427413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04633e20-01f7-4056-8553-756a265947c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.428869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04633e20-01f7-4056-8553-756a265947c1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.432540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da83873-f9dc-447f-9c89-c74f62759827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.433321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da83873-f9dc-447f-9c89-c74f62759827 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.433603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da83873-f9dc-447f-9c89-c74f62759827 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.433877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da83873-f9dc-447f-9c89-c74f62759827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.440407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da83873-f9dc-447f-9c89-c74f62759827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.441265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 342/674] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:41.441827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da83873-f9dc-447f-9c89-c74f62759827 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.442489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab41d6-dc1b-4056-9418-efd4ed82d07d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.442820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab41d6-dc1b-4056-9418-efd4ed82d07d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.443101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab41d6-dc1b-4056-9418-efd4ed82d07d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.443534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:41.447417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 343/675] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:41.447417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab41d6-dc1b-4056-9418-efd4ed82d07d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-8da83873-f9dc-447f-9c89-c74f62759827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:41.460823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:41.461830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:41.462820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:41.462820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:41.462820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:41.462820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:41.462820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:41.462820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:41.462820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:41.462820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:41.462820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 333/676] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:41.463319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da83873-f9dc-447f-9c89-c74f62759827 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:41.536498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:41.558398 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab41d6-dc1b-4056-9418-efd4ed82d07d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.562595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da83873-f9dc-447f-9c89-c74f62759827 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.591140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cd0bf-92ed-49ee-a002-8e6990603f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.591786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd0bf-92ed-49ee-a002-8e6990603f8f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.592068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd0bf-92ed-49ee-a002-8e6990603f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.592340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd0bf-92ed-49ee-a002-8e6990603f8f None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.593121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cd0bf-92ed-49ee-a002-8e6990603f8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:41.593429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cd0bf-92ed-49ee-a002-8e6990603f8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.594866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cd0bf-92ed-49ee-a002-8e6990603f8f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.595980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f64e42-ac19-4009-9203-eb11a8fb1551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.596766 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f64e42-ac19-4009-9203-eb11a8fb1551 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.597044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f64e42-ac19-4009-9203-eb11a8fb1551 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.597324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f64e42-ac19-4009-9203-eb11a8fb1551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.607062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 344/677] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:41.607845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cd0bf-92ed-49ee-a002-8e6990603f8f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:41.608117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f64e42-ac19-4009-9203-eb11a8fb1551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.609555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f64e42-ac19-4009-9203-eb11a8fb1551 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-e3f64e42-ac19-4009-9203-eb11a8fb1551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:41.628793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:41.630181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:41.631143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:41.631143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:41.631143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:41.631143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:41.631143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 334/678] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:41.631143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fd2f7-95a2-4296-9b2b-2430e817d269 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.631477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fd2f7-95a2-4296-9b2b-2430e817d269 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.631685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fd2f7-95a2-4296-9b2b-2430e817d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.647947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e34fd2f7-95a2-4296-9b2b-2430e817d269 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:41.649113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e34fd2f7-95a2-4296-9b2b-2430e817d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:41.694473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:41.708686 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cd0bf-92ed-49ee-a002-8e6990603f8f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.715054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 335/679] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:41.715690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fd2f7-95a2-4296-9b2b-2430e817d269 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:41.760855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4187e3-fabf-496b-97ec-fc25d980a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.761508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4187e3-fabf-496b-97ec-fc25d980a25b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.761793 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4187e3-fabf-496b-97ec-fc25d980a25b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.762073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4187e3-fabf-496b-97ec-fc25d980a25b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.762936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4187e3-fabf-496b-97ec-fc25d980a25b None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=e8eae73572d54dcaac9f3f6bb24df316) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:41.763249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4187e3-fabf-496b-97ec-fc25d980a25b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.764672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4187e3-fabf-496b-97ec-fc25d980a25b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.770415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 345/680] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/role_assignments?user.id=e8eae73572d54dcaac9f3f6bb24df316&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:41.771310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4187e3-fabf-496b-97ec-fc25d980a25b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:41.774673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:41.826634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fd2f7-95a2-4296-9b2b-2430e817d269 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.866228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111999bc-6cdb-45af-adc5-8f85eab7911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.867038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111999bc-6cdb-45af-adc5-8f85eab7911a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.867322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111999bc-6cdb-45af-adc5-8f85eab7911a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.867598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111999bc-6cdb-45af-adc5-8f85eab7911a None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.868415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111999bc-6cdb-45af-adc5-8f85eab7911a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:41.868740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111999bc-6cdb-45af-adc5-8f85eab7911a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.870442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111999bc-6cdb-45af-adc5-8f85eab7911a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.884536 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 336/681] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:41.885419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111999bc-6cdb-45af-adc5-8f85eab7911a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:41.895712 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4187e3-fabf-496b-97ec-fc25d980a25b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:41.933765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:41.934843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd7807-c12f-441e-8470-11c738f9d918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:41.935527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7807-c12f-441e-8470-11c738f9d918 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:41.936260 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7807-c12f-441e-8470-11c738f9d918 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:41.936553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd7807-c12f-441e-8470-11c738f9d918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:41.937662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd7807-c12f-441e-8470-11c738f9d918 None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=a2a5d7aee47e43e9904a93c6ce3bb412) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:41.938044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd7807-c12f-441e-8470-11c738f9d918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:41.939865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd7807-c12f-441e-8470-11c738f9d918 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:41.946378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 346/682] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/role_assignments?user.id=a2a5d7aee47e43e9904a93c6ce3bb412&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:41.948088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd7807-c12f-441e-8470-11c738f9d918 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:42.021619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111999bc-6cdb-45af-adc5-8f85eab7911a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:42.046768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:42.075126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d1d02-1131-4ac1-97ce-5f76069b0819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:42.075814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d1d02-1131-4ac1-97ce-5f76069b0819 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:42.076102 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d1d02-1131-4ac1-97ce-5f76069b0819 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:42.076384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d1d02-1131-4ac1-97ce-5f76069b0819 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:42.077183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d1d02-1131-4ac1-97ce-5f76069b0819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:42.077429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d1d02-1131-4ac1-97ce-5f76069b0819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:42.078879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d1d02-1131-4ac1-97ce-5f76069b0819 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:42.093882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 337/683] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:42.094977 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d1d02-1131-4ac1-97ce-5f76069b0819 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:42.105400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd7807-c12f-441e-8470-11c738f9d918 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:42.160722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adf730-c80a-490c-bb42-c1f7932d8de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:42.161520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf730-c80a-490c-bb42-c1f7932d8de7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:42.161800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf730-c80a-490c-bb42-c1f7932d8de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:42.162072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf730-c80a-490c-bb42-c1f7932d8de7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:42.177637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adf730-c80a-490c-bb42-c1f7932d8de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-02adf730-c80a-490c-bb42-c1f7932d8de7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:42.187251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:42.188219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:42.189051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 347/684] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:42.189745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adf730-c80a-490c-bb42-c1f7932d8de7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:42.217736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:42.222356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d1d02-1131-4ac1-97ce-5f76069b0819 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:42.267189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0e660-b21a-4df9-b3fb-96de94f69108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:42.268037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0e660-b21a-4df9-b3fb-96de94f69108 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:42.268396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0e660-b21a-4df9-b3fb-96de94f69108 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:42.268675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0e660-b21a-4df9-b3fb-96de94f69108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:42.269506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0e660-b21a-4df9-b3fb-96de94f69108 None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=a26055489c284bcf8f0d418e4afffe73) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:42.269821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0e660-b21a-4df9-b3fb-96de94f69108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:42.271556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0e660-b21a-4df9-b3fb-96de94f69108 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:42.282826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 338/685] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:42 2022] GET /identity/v3/role_assignments?user.id=a26055489c284bcf8f0d418e4afffe73&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:42.284800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0e660-b21a-4df9-b3fb-96de94f69108 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:42.338268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adf730-c80a-490c-bb42-c1f7932d8de7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:42.369999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:42.380122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2193-9253-4c35-86ec-d79523f65e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:42.381034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2193-9253-4c35-86ec-d79523f65e51 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:42.381386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2193-9253-4c35-86ec-d79523f65e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:42.381727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2193-9253-4c35-86ec-d79523f65e51 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:42.398147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c2193-9253-4c35-86ec-d79523f65e51 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:42.401123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c2193-9253-4c35-86ec-d79523f65e51 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-847c2193-9253-4c35-86ec-d79523f65e51 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:42.419108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:42.420126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:42.421070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:42.421070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:42.421070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:42.421070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:42.421070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:42.421070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:42.421070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:42.421070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:42.421070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:42.421070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:42.421604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 348/686] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:42.428884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2193-9253-4c35-86ec-d79523f65e51 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:42.507300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0e660-b21a-4df9-b3fb-96de94f69108 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:42.552813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef9f5e-fa09-4701-a413-246e32e80ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:42.553584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef9f5e-fa09-4701-a413-246e32e80ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:42.553865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef9f5e-fa09-4701-a413-246e32e80ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:42.554246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef9f5e-fa09-4701-a413-246e32e80ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:42.555119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef9f5e-fa09-4701-a413-246e32e80ca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:42.555430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef9f5e-fa09-4701-a413-246e32e80ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:42.557258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef9f5e-fa09-4701-a413-246e32e80ca4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:42.576242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 339/687] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:42.583569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef9f5e-fa09-4701-a413-246e32e80ca4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:42.598651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2193-9253-4c35-86ec-d79523f65e51 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:42.626444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:42.643259 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b6e96-0b8d-4955-967c-c222daa90354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:42.644312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b6e96-0b8d-4955-967c-c222daa90354 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:42.644797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b6e96-0b8d-4955-967c-c222daa90354 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:42.645272 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b6e96-0b8d-4955-967c-c222daa90354 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:42.646338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b6e96-0b8d-4955-967c-c222daa90354 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:42.646889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b6e96-0b8d-4955-967c-c222daa90354 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:42.648523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b6e96-0b8d-4955-967c-c222daa90354 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:42.669379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 349/688] 10.222.0.30 () {56 vars in 1135 bytes} [Mon May 23 17:54:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:42.675554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b6e96-0b8d-4955-967c-c222daa90354 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:42.752180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef9f5e-fa09-4701-a413-246e32e80ca4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:42.760230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:42.803250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1129e-7323-446f-89f4-c33fafaad1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:42.804090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1129e-7323-446f-89f4-c33fafaad1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:42.804361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1129e-7323-446f-89f4-c33fafaad1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:42.804633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1129e-7323-446f-89f4-c33fafaad1a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:42.821690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1129e-7323-446f-89f4-c33fafaad1a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:42.830297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b6e96-0b8d-4955-967c-c222daa90354 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:42.831513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1129e-7323-446f-89f4-c33fafaad1a1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-d0f1129e-7323-446f-89f4-c33fafaad1a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:42.854253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:42.855235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:42.856131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:42.856131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:42.856131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:42.856131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:42.863411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 340/689] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:42.869310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1129e-7323-446f-89f4-c33fafaad1a1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:42.871003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e112c-900b-4d90-99b5-28d73702409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:42.871915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e112c-900b-4d90-99b5-28d73702409c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:42.872420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e112c-900b-4d90-99b5-28d73702409c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:42.872900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e112c-900b-4d90-99b5-28d73702409c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:42.971963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e112c-900b-4d90-99b5-28d73702409c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:42.973770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e112c-900b-4d90-99b5-28d73702409c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:43.023376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:43.064185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:43.084101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 350/690] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 17:54:43.090255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e112c-900b-4d90-99b5-28d73702409c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:43.140815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1129e-7323-446f-89f4-c33fafaad1a1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:43.197297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e112c-900b-4d90-99b5-28d73702409c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:43.233279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8288f-d1de-4fb1-9e14-21c255f25b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:43.234006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb90de-4863-4c55-a7e9-864b914a6f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:43.234132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8288f-d1de-4fb1-9e14-21c255f25b53 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:43.234343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8288f-d1de-4fb1-9e14-21c255f25b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:43.234616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8288f-d1de-4fb1-9e14-21c255f25b53 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:43.235338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8288f-d1de-4fb1-9e14-21c255f25b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:43.235650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8288f-d1de-4fb1-9e14-21c255f25b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:43.236160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb90de-4863-4c55-a7e9-864b914a6f99 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:43.236641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb90de-4863-4c55-a7e9-864b914a6f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:43.237042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8288f-d1de-4fb1-9e14-21c255f25b53 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:43.237687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb90de-4863-4c55-a7e9-864b914a6f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:43.251546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 341/691] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:43.263095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8288f-d1de-4fb1-9e14-21c255f25b53 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:43.265516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb90de-4863-4c55-a7e9-864b914a6f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:43.267337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb90de-4863-4c55-a7e9-864b914a6f99 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:43.287852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-78bb90de-4863-4c55-a7e9-864b914a6f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:43.291234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:43.292508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:43.293430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:43.293430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:43.293430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:43.293430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:43.295661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 351/692] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:43.301178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb90de-4863-4c55-a7e9-864b914a6f99 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:43.409059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb90de-4863-4c55-a7e9-864b914a6f99 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:43.445727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085566d-36e9-41cc-9c0f-555b14a6a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:43.446845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085566d-36e9-41cc-9c0f-555b14a6a5fb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:43.447343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085566d-36e9-41cc-9c0f-555b14a6a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:43.447909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085566d-36e9-41cc-9c0f-555b14a6a5fb None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:43.448873 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085566d-36e9-41cc-9c0f-555b14a6a5fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:43.449386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085566d-36e9-41cc-9c0f-555b14a6a5fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:43.452009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085566d-36e9-41cc-9c0f-555b14a6a5fb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:43.472509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8288f-d1de-4fb1-9e14-21c255f25b53 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:43.474740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 352/693] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:43.486722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085566d-36e9-41cc-9c0f-555b14a6a5fb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:43.545478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab919-7968-411e-9ef2-d61647694a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:43.546274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab919-7968-411e-9ef2-d61647694a6a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:43.546553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab919-7968-411e-9ef2-d61647694a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:43.546960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab919-7968-411e-9ef2-d61647694a6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:43.561028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eab919-7968-411e-9ef2-d61647694a6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:43.562477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eab919-7968-411e-9ef2-d61647694a6a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:43.567795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-47eab919-7968-411e-9ef2-d61647694a6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:43.585780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:43.586948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:43.588542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 342/694] 10.222.0.30 () {56 vars in 1093 bytes} [Mon May 23 17:54:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:43.594919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab919-7968-411e-9ef2-d61647694a6a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:43.609281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:43.676505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085566d-36e9-41cc-9c0f-555b14a6a5fb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:43.737490 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e50f0-d2a4-4539-a73b-b4253803682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:43.738284 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e50f0-d2a4-4539-a73b-b4253803682c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:43.738565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e50f0-d2a4-4539-a73b-b4253803682c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:43.738877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e50f0-d2a4-4539-a73b-b4253803682c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:43.750882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e50f0-d2a4-4539-a73b-b4253803682c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:43.755196 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e50f0-d2a4-4539-a73b-b4253803682c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e21e50f0-d2a4-4539-a73b-b4253803682c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:43.781613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:43.782619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:43.783605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:43.783605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:43.783605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:43.783605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:43.783605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:43.783605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:43.783605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:43.783605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:43.784038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab919-7968-411e-9ef2-d61647694a6a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:43.787319 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 353/695] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:43.794814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e50f0-d2a4-4539-a73b-b4253803682c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:43.845498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ddc7a-8cd2-4e18-b4dd-a206e72bd5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:43.846177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ddc7a-8cd2-4e18-b4dd-a206e72bd5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:43.846460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ddc7a-8cd2-4e18-b4dd-a206e72bd5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:43.846760 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ddc7a-8cd2-4e18-b4dd-a206e72bd5b6 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:43.847612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ddc7a-8cd2-4e18-b4dd-a206e72bd5b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:43.847923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ddc7a-8cd2-4e18-b4dd-a206e72bd5b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:43.849352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ddc7a-8cd2-4e18-b4dd-a206e72bd5b6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:43.883161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 343/696] 10.222.0.30 () {56 vars in 1133 bytes} [Mon May 23 17:54:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:43.888243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ddc7a-8cd2-4e18-b4dd-a206e72bd5b6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:43.965712 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e50f0-d2a4-4539-a73b-b4253803682c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:43.966309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:44.002472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:44.031803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3dd7-12b7-4af3-b3a4-ea72195379f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:44.033579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3dd7-12b7-4af3-b3a4-ea72195379f6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:44.034750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3dd7-12b7-4af3-b3a4-ea72195379f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:44.035393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3dd7-12b7-4af3-b3a4-ea72195379f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:44.037436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e3dd7-12b7-4af3-b3a4-ea72195379f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:44.038660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e3dd7-12b7-4af3-b3a4-ea72195379f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:44.040352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e3dd7-12b7-4af3-b3a4-ea72195379f6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:44.053233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ddc7a-8cd2-4e18-b4dd-a206e72bd5b6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:44.064986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 354/697] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:44.071794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3dd7-12b7-4af3-b3a4-ea72195379f6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:44.117003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f50f8-84bb-4caf-92bd-37d162d998c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:44.118091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f50f8-84bb-4caf-92bd-37d162d998c0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:44.118669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f50f8-84bb-4caf-92bd-37d162d998c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:44.119421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f50f8-84bb-4caf-92bd-37d162d998c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:44.241815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f50f8-84bb-4caf-92bd-37d162d998c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:44.244237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f50f8-84bb-4caf-92bd-37d162d998c0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:44.260887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3dd7-12b7-4af3-b3a4-ea72195379f6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:44.318382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdc0d8-855d-402d-ba03-3c539672460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:44.319061 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc0d8-855d-402d-ba03-3c539672460c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:44.319344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc0d8-855d-402d-ba03-3c539672460c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:44.319618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc0d8-855d-402d-ba03-3c539672460c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:44.320450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdc0d8-855d-402d-ba03-3c539672460c None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=fcbd7035e027494cb063489b375cb385) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:44.320759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdc0d8-855d-402d-ba03-3c539672460c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:44.323009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdc0d8-855d-402d-ba03-3c539672460c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:44.328723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:44.329272 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 355/698] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:44 2022] GET /identity/v3/role_assignments?user.id=fcbd7035e027494cb063489b375cb385&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:44.330522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a5e6-a07a-4884-a024-a2530d26c0c5 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:44.330854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a5e6-a07a-4884-a024-a2530d26c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:44.331136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a5e6-a07a-4884-a024-a2530d26c0c5 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:44.335092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 356/699] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:44.338044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebc99-0227-4730-aab7-f9d6f2eb653a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:44.339089 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebc99-0227-4730-aab7-f9d6f2eb653a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:44.339386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebc99-0227-4730-aab7-f9d6f2eb653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:44.378797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-df0ebc99-0227-4730-aab7-f9d6f2eb653a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:44.380012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-df0ebc99-0227-4730-aab7-f9d6f2eb653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:44.394269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 344/700] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:44.399818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f50f8-84bb-4caf-92bd-37d162d998c0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:44.503230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:44.516974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f50f8-84bb-4caf-92bd-37d162d998c0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:44.562539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6754a8-f0c7-4e4c-a9e3-34365d512e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:44.563385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6754a8-f0c7-4e4c-a9e3-34365d512e3d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:44.563673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6754a8-f0c7-4e4c-a9e3-34365d512e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:44.563945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6754a8-f0c7-4e4c-a9e3-34365d512e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:44.583933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6754a8-f0c7-4e4c-a9e3-34365d512e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:44.585450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6754a8-f0c7-4e4c-a9e3-34365d512e3d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:44.591517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 357/701] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5e6754a8-f0c7-4e4c-a9e3-34365d512e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:44.618149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:44.619211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:44.620359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:44.620359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:44.620359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:44.620359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:44.620583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ebc99-0227-4730-aab7-f9d6f2eb653a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:44.620978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 345/702] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:44.628079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6754a8-f0c7-4e4c-a9e3-34365d512e3d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:44.640604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:44.753767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6754a8-f0c7-4e4c-a9e3-34365d512e3d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:44.756120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ebc99-0227-4730-aab7-f9d6f2eb653a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:44.797182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da19811-653d-4030-94b8-efd821e43c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:44.797863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da19811-653d-4030-94b8-efd821e43c7e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:44.798122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da19811-653d-4030-94b8-efd821e43c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:44.798448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da19811-653d-4030-94b8-efd821e43c7e None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:44.799236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da19811-653d-4030-94b8-efd821e43c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:44.799509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da19811-653d-4030-94b8-efd821e43c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:44.800970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da19811-653d-4030-94b8-efd821e43c7e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:44.805221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda89c3-9feb-4d70-941c-af7d5971df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:44.806324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda89c3-9feb-4d70-941c-af7d5971df0b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:44.806854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda89c3-9feb-4d70-941c-af7d5971df0b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:44.807340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda89c3-9feb-4d70-941c-af7d5971df0b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:44.808723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda89c3-9feb-4d70-941c-af7d5971df0b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:44.810842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda89c3-9feb-4d70-941c-af7d5971df0b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:44.813514 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 346/703] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:44.814928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca2cee-6156-4149-828d-bd5012c5d30e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:44.815215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca2cee-6156-4149-828d-bd5012c5d30e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:44.815491 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca2cee-6156-4149-828d-bd5012c5d30e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:44.821061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 347/704] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:44.823141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca2cee-6156-4149-828d-bd5012c5d30e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-2fda89c3-9feb-4d70-941c-af7d5971df0b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:44.835563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:44.836564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:54:44.838005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:44.844634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 358/705] 10.222.0.30 () {56 vars in 1129 bytes} [Mon May 23 17:54:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:44.844634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f232a-0fc7-499f-af78-19735cc64901 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:44.844634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f232a-0fc7-499f-af78-19735cc64901 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:44.844634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f232a-0fc7-499f-af78-19735cc64901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:44.863228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6d8f232a-0fc7-499f-af78-19735cc64901 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:44.864445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6d8f232a-0fc7-499f-af78-19735cc64901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:44.903234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:44.919363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:44.945969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 359/706] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:44.955257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f232a-0fc7-499f-af78-19735cc64901 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:44.965546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca2cee-6156-4149-828d-bd5012c5d30e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:45.002654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a43a71-f397-4df6-bb8b-50642a98b793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:45.003977 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a43a71-f397-4df6-bb8b-50642a98b793 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.004469 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a43a71-f397-4df6-bb8b-50642a98b793 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.004945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a43a71-f397-4df6-bb8b-50642a98b793 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.013310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a43a71-f397-4df6-bb8b-50642a98b793 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:45.015121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a43a71-f397-4df6-bb8b-50642a98b793 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-34a43a71-f397-4df6-bb8b-50642a98b793 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:45.029972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:45.031154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:45.032065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:45.032065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:45.032065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:45.032065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:45.032065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:45.032065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:45.032065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:45.032065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:45.034401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 348/707] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:45.035486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a43a71-f397-4df6-bb8b-50642a98b793 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:45.080738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f232a-0fc7-499f-af78-19735cc64901 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:45.116062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d0c3a-5e03-4f4d-9faa-66ba6b722d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:45.116715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0c3a-5e03-4f4d-9faa-66ba6b722d8e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.116993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0c3a-5e03-4f4d-9faa-66ba6b722d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.117261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0c3a-5e03-4f4d-9faa-66ba6b722d8e None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.118349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d0c3a-5e03-4f4d-9faa-66ba6b722d8e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:45.119136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d0c3a-5e03-4f4d-9faa-66ba6b722d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:45.120520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d0c3a-5e03-4f4d-9faa-66ba6b722d8e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:45.131796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 360/708] 10.222.0.30 () {56 vars in 1124 bytes} [Mon May 23 17:54:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:45.131796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d0c3a-5e03-4f4d-9faa-66ba6b722d8e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:45.143055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a43a71-f397-4df6-bb8b-50642a98b793 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:45.163116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:45.172655 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:45.183385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef7f02-d0c6-4ea9-9d7f-a1ab9348f445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:45.184220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef7f02-d0c6-4ea9-9d7f-a1ab9348f445 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.184504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef7f02-d0c6-4ea9-9d7f-a1ab9348f445 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.184781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef7f02-d0c6-4ea9-9d7f-a1ab9348f445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.196177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef7f02-d0c6-4ea9-9d7f-a1ab9348f445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:45.198259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef7f02-d0c6-4ea9-9d7f-a1ab9348f445 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-47ef7f02-d0c6-4ea9-9d7f-a1ab9348f445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:45.218825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:45.219729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:45.220622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:45.220622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:45.220622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:45.220622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:45.227555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 349/709] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:45.227555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4268f0-743c-410d-94a9-55fcb3edc09f None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.227555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4268f0-743c-410d-94a9-55fcb3edc09f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.227555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4268f0-743c-410d-94a9-55fcb3edc09f None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.227555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 350/710] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:45.227555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4268f0-743c-410d-94a9-55fcb3edc09f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:45.246999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d0c3a-5e03-4f4d-9faa-66ba6b722d8e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:45.284015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5cad7-b24a-4581-8129-276ebf90eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:45.285065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5cad7-b24a-4581-8129-276ebf90eb8f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.285371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5cad7-b24a-4581-8129-276ebf90eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.285807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5cad7-b24a-4581-8129-276ebf90eb8f None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.286922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5cad7-b24a-4581-8129-276ebf90eb8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:45.287396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5cad7-b24a-4581-8129-276ebf90eb8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:45.289166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5cad7-b24a-4581-8129-276ebf90eb8f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:45.306438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 361/711] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:45.306438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5cad7-b24a-4581-8129-276ebf90eb8f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:45.341691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4268f0-743c-410d-94a9-55fcb3edc09f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:45.377909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449b18a-17c6-4ff9-833d-8aae2b2bcdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:45.378581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b18a-17c6-4ff9-833d-8aae2b2bcdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.379213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b18a-17c6-4ff9-833d-8aae2b2bcdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.379213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b18a-17c6-4ff9-833d-8aae2b2bcdc2 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.379868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449b18a-17c6-4ff9-833d-8aae2b2bcdc2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:45.380176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449b18a-17c6-4ff9-833d-8aae2b2bcdc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:45.381550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449b18a-17c6-4ff9-833d-8aae2b2bcdc2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:45.388450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 351/712] 10.222.0.30 () {56 vars in 1124 bytes} [Mon May 23 17:54:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:45.389482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376221-a5c2-4c39-9597-a97d79d1074e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.389770 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376221-a5c2-4c39-9597-a97d79d1074e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.390043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376221-a5c2-4c39-9597-a97d79d1074e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.417758 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1f376221-a5c2-4c39-9597-a97d79d1074e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:45.419011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1f376221-a5c2-4c39-9597-a97d79d1074e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:45.430570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:45.445367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5cad7-b24a-4581-8129-276ebf90eb8f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:45.468125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:45.484534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783b13a-857a-4061-b901-2106742a3b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:45.485204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b13a-857a-4061-b901-2106742a3b10 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.485487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b13a-857a-4061-b901-2106742a3b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.485764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b13a-857a-4061-b901-2106742a3b10 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.486496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b13a-857a-4061-b901-2106742a3b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:45.486831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b13a-857a-4061-b901-2106742a3b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:45.488264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b13a-857a-4061-b901-2106742a3b10 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:45.502332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 352/713] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:45.503344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f376221-a5c2-4c39-9597-a97d79d1074e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:45.510498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 362/714] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:45.515891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783b13a-857a-4061-b901-2106742a3b10 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:45.628391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f376221-a5c2-4c39-9597-a97d79d1074e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:45.670390 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dbb17-eee3-40c7-a3e5-ac66c3c48c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:45.671106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dbb17-eee3-40c7-a3e5-ac66c3c48c75 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.671388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dbb17-eee3-40c7-a3e5-ac66c3c48c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.671661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dbb17-eee3-40c7-a3e5-ac66c3c48c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.672502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dbb17-eee3-40c7-a3e5-ac66c3c48c75 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=9021e2249e11489083139e210562ce44) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:45.672815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dbb17-eee3-40c7-a3e5-ac66c3c48c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:45.674277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dbb17-eee3-40c7-a3e5-ac66c3c48c75 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:45.681126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 353/715] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:45 2022] GET /identity/v3/role_assignments?user.id=9021e2249e11489083139e210562ce44&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=af8084c48e3c40298e26d44d6d14595a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:45.682340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dbb17-eee3-40c7-a3e5-ac66c3c48c75 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:45.727425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:45.808054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dbb17-eee3-40c7-a3e5-ac66c3c48c75 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:45.840238 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783b13a-857a-4061-b901-2106742a3b10 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:45.891800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec4f48-f9a5-4669-91c3-ea1898929691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:45.892628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec4f48-f9a5-4669-91c3-ea1898929691 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.892907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec4f48-f9a5-4669-91c3-ea1898929691 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.893173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec4f48-f9a5-4669-91c3-ea1898929691 None admin] PATH_INFO: `/v3/services/network` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.893932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec4f48-f9a5-4669-91c3-ea1898929691 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:45.895454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec4f48-f9a5-4669-91c3-ea1898929691 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:45.900440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a02b72-d7eb-45a2-8a07-98a68de13abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:45.901540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a02b72-d7eb-45a2-8a07-98a68de13abf None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:45.901981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a02b72-d7eb-45a2-8a07-98a68de13abf None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:45.902411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a02b72-d7eb-45a2-8a07-98a68de13abf None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:45.903367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a02b72-d7eb-45a2-8a07-98a68de13abf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:45.904993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a02b72-d7eb-45a2-8a07-98a68de13abf None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-30ec4f48-f9a5-4669-91c3-ea1898929691 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:45.921952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:45.923259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:54:45.924313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:45.926917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 354/716] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:45 2022] GET /identity/v3/services/network => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:45.934257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec4f48-f9a5-4669-91c3-ea1898929691 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:45.937440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 363/717] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:54:45 2022] POST /identity/v3/users => generated 254 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:54:46.084331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec4f48-f9a5-4669-91c3-ea1898929691 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:46.086328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:46.135787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570a594-e83d-41da-b3b7-eade860f7433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:46.136483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570a594-e83d-41da-b3b7-eade860f7433 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:46.136771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570a594-e83d-41da-b3b7-eade860f7433 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:46.137052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570a594-e83d-41da-b3b7-eade860f7433 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:46.137776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570a594-e83d-41da-b3b7-eade860f7433 None admin] RBAC: Adding query filter params (name=network) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:46.138089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570a594-e83d-41da-b3b7-eade860f7433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:46.139515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570a594-e83d-41da-b3b7-eade860f7433 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:46.147600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 355/718] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:54:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:46.154200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a02b72-d7eb-45a2-8a07-98a68de13abf None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:46.163815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:46.263572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a02b72-d7eb-45a2-8a07-98a68de13abf None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:46.299254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c761d-04e2-4f0c-afde-7fd94244a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:46.299975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c761d-04e2-4f0c-afde-7fd94244a0cb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:46.300263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c761d-04e2-4f0c-afde-7fd94244a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:46.300540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c761d-04e2-4f0c-afde-7fd94244a0cb None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:46.301253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c761d-04e2-4f0c-afde-7fd94244a0cb None admin] RBAC: Adding query filter params (type=network) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:46.301558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c761d-04e2-4f0c-afde-7fd94244a0cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:46.302946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c761d-04e2-4f0c-afde-7fd94244a0cb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:46.309116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 364/719] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:54:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:47.063093 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7a0f-d8ce-4ea0-be20-552bd80c44e1 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:47.063615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7a0f-d8ce-4ea0-be20-552bd80c44e1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:47.063692 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7a0f-d8ce-4ea0-be20-552bd80c44e1 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:47.065262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 356/720] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:47.080232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5734f-eab6-4b40-9745-da7e24d52124 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:47.080781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5734f-eab6-4b40-9745-da7e24d52124 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:47.080781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5734f-eab6-4b40-9745-da7e24d52124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:47.106822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e4f5734f-eab6-4b40-9745-da7e24d52124 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:47.108021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e4f5734f-eab6-4b40-9745-da7e24d52124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:47.184488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:47.193531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 365/721] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:47.230335 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7a0f-d8ce-4ea0-be20-552bd80c44e1 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:47.352896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7a0f-d8ce-4ea0-be20-552bd80c44e1 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:47.400420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab39db-ce4a-49c8-b27a-12f4032757d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:47.401228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab39db-ce4a-49c8-b27a-12f4032757d1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:47.401516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab39db-ce4a-49c8-b27a-12f4032757d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:47.401793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab39db-ce4a-49c8-b27a-12f4032757d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:47.416925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab39db-ce4a-49c8-b27a-12f4032757d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-8dab39db-ce4a-49c8-b27a-12f4032757d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:47.424658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:47.425576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:47.426440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 357/722] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:47.432163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5734f-eab6-4b40-9745-da7e24d52124 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:47.582839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5734f-eab6-4b40-9745-da7e24d52124 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:47.631993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9556bc1-28de-4074-ba84-4ae9330d254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:47.632581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9556bc1-28de-4074-ba84-4ae9330d254a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:47.632858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9556bc1-28de-4074-ba84-4ae9330d254a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:47.633125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9556bc1-28de-4074-ba84-4ae9330d254a None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:47.634158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9556bc1-28de-4074-ba84-4ae9330d254a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:47.634461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9556bc1-28de-4074-ba84-4ae9330d254a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:47.635842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9556bc1-28de-4074-ba84-4ae9330d254a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:47.650469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 366/723] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:47.655892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab39db-ce4a-49c8-b27a-12f4032757d1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:47.693993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:47.796545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab39db-ce4a-49c8-b27a-12f4032757d1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:47.845516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2700ba3-1238-493e-9518-9f852ed25354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:47.846313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2700ba3-1238-493e-9518-9f852ed25354 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:47.846595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2700ba3-1238-493e-9518-9f852ed25354 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:47.846898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2700ba3-1238-493e-9518-9f852ed25354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:47.866946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2700ba3-1238-493e-9518-9f852ed25354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:47.868457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2700ba3-1238-493e-9518-9f852ed25354 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c2700ba3-1238-493e-9518-9f852ed25354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:47.889907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:47.892041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:47.894217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:47.894217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:47.894217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:47.894217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:47.894217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 358/724] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:47.896924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9556bc1-28de-4074-ba84-4ae9330d254a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:47.992487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:48.034752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9556bc1-28de-4074-ba84-4ae9330d254a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:48.086516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8e513-f366-4fbe-851e-10f0e7698dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:48.087857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8e513-f366-4fbe-851e-10f0e7698dee None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:48.088232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8e513-f366-4fbe-851e-10f0e7698dee None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:48.088577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8e513-f366-4fbe-851e-10f0e7698dee None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:48.089300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8e513-f366-4fbe-851e-10f0e7698dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:48.089605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8e513-f366-4fbe-851e-10f0e7698dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:48.090983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8e513-f366-4fbe-851e-10f0e7698dee None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:48.108463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 367/725] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:48.113581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2700ba3-1238-493e-9518-9f852ed25354 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:48.391257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:48.426152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2700ba3-1238-493e-9518-9f852ed25354 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:48.469246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2e8b-1464-4e4f-93db-a5035c27a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:48.470048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2e8b-1464-4e4f-93db-a5035c27a318 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:48.470332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2e8b-1464-4e4f-93db-a5035c27a318 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:48.470597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2e8b-1464-4e4f-93db-a5035c27a318 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:48.479018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f2e8b-1464-4e4f-93db-a5035c27a318 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:48.480474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f2e8b-1464-4e4f-93db-a5035c27a318 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-2f0f2e8b-1464-4e4f-93db-a5035c27a318 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:48.498460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:48.499482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:48.500440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:48.500440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:48.500440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:48.500440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:48.500440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:48.500440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:48.500440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:48.500440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:48.500440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:48.500440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:48.510408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8e513-f366-4fbe-851e-10f0e7698dee None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:48.512723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 359/726] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:48.532557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e029e-9eee-49ae-9da3-e7c66b2dc6e6 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:48.532846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e029e-9eee-49ae-9da3-e7c66b2dc6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:48.533130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e029e-9eee-49ae-9da3-e7c66b2dc6e6 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:48.537775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 360/727] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:54:48.539927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f314d-3374-4a9a-9123-648b502d535a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:48.540759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f314d-3374-4a9a-9123-648b502d535a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:48.541045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f314d-3374-4a9a-9123-648b502d535a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:48.558654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-526f314d-3374-4a9a-9123-648b502d535a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:48.559948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-526f314d-3374-4a9a-9123-648b502d535a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:48.647983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 361/728] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 17:54:48.649324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8a8a-f0c2-4cc2-98b8-89c0e1b6d0e7 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:48.649662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8a8a-f0c2-4cc2-98b8-89c0e1b6d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:48.650018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8a8a-f0c2-4cc2-98b8-89c0e1b6d0e7 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:48.651668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 362/729] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:48.657095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f0dc3-d551-4cf6-a640-c29d2e1cde45 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:48.657408 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f0dc3-d551-4cf6-a640-c29d2e1cde45 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:48.657642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f0dc3-d551-4cf6-a640-c29d2e1cde45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:48.669227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8e513-f366-4fbe-851e-10f0e7698dee None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:48.681533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b24f0dc3-d551-4cf6-a640-c29d2e1cde45 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:48.682880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b24f0dc3-d551-4cf6-a640-c29d2e1cde45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:48.694557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:48.706920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40368f63-6e91-46b0-a83a-c53b4b3e0196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:48.707674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40368f63-6e91-46b0-a83a-c53b4b3e0196 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:48.707983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40368f63-6e91-46b0-a83a-c53b4b3e0196 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:48.708218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40368f63-6e91-46b0-a83a-c53b4b3e0196 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:48.709045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40368f63-6e91-46b0-a83a-c53b4b3e0196 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:48.709347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40368f63-6e91-46b0-a83a-c53b4b3e0196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:48.710779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40368f63-6e91-46b0-a83a-c53b4b3e0196 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:48.729928 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 368/730] 10.222.0.30 () {56 vars in 1135 bytes} [Mon May 23 17:54:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:48.734921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40368f63-6e91-46b0-a83a-c53b4b3e0196 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:48.755181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:48.763550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 363/731] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:48.764565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f0dc3-d551-4cf6-a640-c29d2e1cde45 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:48.850732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40368f63-6e91-46b0-a83a-c53b4b3e0196 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:48.883773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f0dc3-d551-4cf6-a640-c29d2e1cde45 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:48.888529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e887c18-9597-48f0-ba5b-ceaa04a4b24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:48.889336 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e887c18-9597-48f0-ba5b-ceaa04a4b24d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:48.889614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e887c18-9597-48f0-ba5b-ceaa04a4b24d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:48.889883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e887c18-9597-48f0-ba5b-ceaa04a4b24d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:48.902451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e887c18-9597-48f0-ba5b-ceaa04a4b24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-9e887c18-9597-48f0-ba5b-ceaa04a4b24d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:48.910088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:48.912325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 369/732] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:48.914313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e887c18-9597-48f0-ba5b-ceaa04a4b24d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:48.927991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657806f-aa5a-4e54-8075-e0144f0319f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:48.928728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657806f-aa5a-4e54-8075-e0144f0319f2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:48.929078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657806f-aa5a-4e54-8075-e0144f0319f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:48.929420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657806f-aa5a-4e54-8075-e0144f0319f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:48.969672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:49.013422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:49.017355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657806f-aa5a-4e54-8075-e0144f0319f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:49.018865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657806f-aa5a-4e54-8075-e0144f0319f2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:49.033739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e887c18-9597-48f0-ba5b-ceaa04a4b24d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:49.071089 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8103f-f42d-476e-ba87-8f32da6866bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:49.072407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8103f-f42d-476e-ba87-8f32da6866bb None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.072682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8103f-f42d-476e-ba87-8f32da6866bb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.073341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8103f-f42d-476e-ba87-8f32da6866bb None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.073672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8103f-f42d-476e-ba87-8f32da6866bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:49.075048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8103f-f42d-476e-ba87-8f32da6866bb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:49.089680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 370/733] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:54:48 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:54:49.091275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8103f-f42d-476e-ba87-8f32da6866bb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:49.141040 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 364/734] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 17:54:49.141592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0fcc-7efa-4b48-8d7c-bdb66c39bbe3 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.141592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0fcc-7efa-4b48-8d7c-bdb66c39bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.142140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0fcc-7efa-4b48-8d7c-bdb66c39bbe3 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.143852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 365/735] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:49.145512 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0e1a-6a78-458c-8ad5-e174f2bfeb70 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.145799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0e1a-6a78-458c-8ad5-e174f2bfeb70 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.146073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0e1a-6a78-458c-8ad5-e174f2bfeb70 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.147836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 366/736] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:49.148391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae0e1a-6a78-458c-8ad5-e174f2bfeb70 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:49.209182 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:49.228137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8103f-f42d-476e-ba87-8f32da6866bb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:49.262830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:49.266383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0300aae-d915-44cb-9b2b-8a4cf0cc85ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:49.267091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0300aae-d915-44cb-9b2b-8a4cf0cc85ad None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.267565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0300aae-d915-44cb-9b2b-8a4cf0cc85ad None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.267996 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0300aae-d915-44cb-9b2b-8a4cf0cc85ad None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.268280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae0e1a-6a78-458c-8ad5-e174f2bfeb70 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:49.268752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0300aae-d915-44cb-9b2b-8a4cf0cc85ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:49.269056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0300aae-d915-44cb-9b2b-8a4cf0cc85ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:49.270437 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0300aae-d915-44cb-9b2b-8a4cf0cc85ad None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:49.280551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 371/737] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:49.282010 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38824-e214-468b-8a11-4986a5eeaeb0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.282427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38824-e214-468b-8a11-4986a5eeaeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.282857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38824-e214-468b-8a11-4986a5eeaeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.301914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9ff38824-e214-468b-8a11-4986a5eeaeb0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:49.303129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9ff38824-e214-468b-8a11-4986a5eeaeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:49.312312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82136c31-5cd9-4efb-9c1d-f9672b4dc7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:49.313116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136c31-5cd9-4efb-9c1d-f9672b4dc7ea None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.313398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136c31-5cd9-4efb-9c1d-f9672b4dc7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.313731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136c31-5cd9-4efb-9c1d-f9672b4dc7ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.325139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82136c31-5cd9-4efb-9c1d-f9672b4dc7ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:49.326581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82136c31-5cd9-4efb-9c1d-f9672b4dc7ea None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-82136c31-5cd9-4efb-9c1d-f9672b4dc7ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:49.346734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:49.347681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:49.348581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:49.348581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:49.348581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:49.348581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:49.348817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 367/738] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:49.350132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8e74-982a-4762-b78a-fb4e4d6f9fab None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.350425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8e74-982a-4762-b78a-fb4e4d6f9fab None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.350736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8e74-982a-4762-b78a-fb4e4d6f9fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.367415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-bdad8e74-982a-4762-b78a-fb4e4d6f9fab None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:49.369136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bdad8e74-982a-4762-b78a-fb4e4d6f9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:49.377710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 372/739] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:49.378371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff38824-e214-468b-8a11-4986a5eeaeb0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:49.451805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 368/740] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 17:54:49.453029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8e74-982a-4762-b78a-fb4e4d6f9fab None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:49.483521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:49.498005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff38824-e214-468b-8a11-4986a5eeaeb0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:49.539370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f6c1b-86f3-4a04-ab7b-20414983f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:49.540311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f6c1b-86f3-4a04-ab7b-20414983f0da None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.540808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f6c1b-86f3-4a04-ab7b-20414983f0da None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.541089 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f6c1b-86f3-4a04-ab7b-20414983f0da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.552736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:49.553842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f6c1b-86f3-4a04-ab7b-20414983f0da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:49.555423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f6c1b-86f3-4a04-ab7b-20414983f0da None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-712f6c1b-86f3-4a04-ab7b-20414983f0da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:49.574834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:49.575782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:49.576675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:49.576675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:49.576675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:49.576675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:49.576898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8e74-982a-4762-b78a-fb4e4d6f9fab None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:49.580479 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 373/741] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:49.581237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f6c1b-86f3-4a04-ab7b-20414983f0da None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:49.613990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e9389-37cb-4c1a-8292-d3c3d3758c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:49.615259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e9389-37cb-4c1a-8292-d3c3d3758c5c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.615559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e9389-37cb-4c1a-8292-d3c3d3758c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.615839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e9389-37cb-4c1a-8292-d3c3d3758c5c None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.616574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e9389-37cb-4c1a-8292-d3c3d3758c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:49.616883 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e9389-37cb-4c1a-8292-d3c3d3758c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:49.619548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e9389-37cb-4c1a-8292-d3c3d3758c5c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:49.631248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 369/742] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:49.632066 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e9389-37cb-4c1a-8292-d3c3d3758c5c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:49.697339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f6c1b-86f3-4a04-ab7b-20414983f0da None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:49.739594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e9389-37cb-4c1a-8292-d3c3d3758c5c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:49.741598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14dc1f-b9a0-4cf7-acdc-ff1f28edb496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:49.742272 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14dc1f-b9a0-4cf7-acdc-ff1f28edb496 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.742558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14dc1f-b9a0-4cf7-acdc-ff1f28edb496 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.742884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14dc1f-b9a0-4cf7-acdc-ff1f28edb496 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.744280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14dc1f-b9a0-4cf7-acdc-ff1f28edb496 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:49.745657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14dc1f-b9a0-4cf7-acdc-ff1f28edb496 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:49.754923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:49.770732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 374/743] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:54:49 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:54:49.770732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14dc1f-b9a0-4cf7-acdc-ff1f28edb496 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:49.796622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158e3ab-bccf-4af7-81ab-5fcb51f66e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:49.797542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158e3ab-bccf-4af7-81ab-5fcb51f66e9f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.797923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158e3ab-bccf-4af7-81ab-5fcb51f66e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.798252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158e3ab-bccf-4af7-81ab-5fcb51f66e9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.801877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:49.814023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158e3ab-bccf-4af7-81ab-5fcb51f66e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c158e3ab-bccf-4af7-81ab-5fcb51f66e9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:49.822607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:49.823666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:49.824535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 370/744] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:49.825258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158e3ab-bccf-4af7-81ab-5fcb51f66e9f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:49.925006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14dc1f-b9a0-4cf7-acdc-ff1f28edb496 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:49.944109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158e3ab-bccf-4af7-81ab-5fcb51f66e9f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:49.974212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42df300-78ee-4f3c-ac34-38e114500e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:49.974918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42df300-78ee-4f3c-ac34-38e114500e12 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.975201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42df300-78ee-4f3c-ac34-38e114500e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.975477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42df300-78ee-4f3c-ac34-38e114500e12 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.976200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42df300-78ee-4f3c-ac34-38e114500e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:49.976513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42df300-78ee-4f3c-ac34-38e114500e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:49.978457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42df300-78ee-4f3c-ac34-38e114500e12 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:49.989005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e84b7-3e97-4c0d-a6bf-3790b529221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:49.990237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e84b7-3e97-4c0d-a6bf-3790b529221b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:49.990792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e84b7-3e97-4c0d-a6bf-3790b529221b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:49.991212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 375/745] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:49.991516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e84b7-3e97-4c0d-a6bf-3790b529221b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:49.992169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42df300-78ee-4f3c-ac34-38e114500e12 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:50.000477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e84b7-3e97-4c0d-a6bf-3790b529221b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:50.002224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e84b7-3e97-4c0d-a6bf-3790b529221b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-053e84b7-3e97-4c0d-a6bf-3790b529221b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:50.020691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:50.021823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:50.022953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:50.022953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:50.022953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:50.022953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:50.022953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:50.022953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:50.022953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:50.022953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:50.023473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 371/746] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:50.024190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e84b7-3e97-4c0d-a6bf-3790b529221b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:50.067848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:50.099465 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:50.120540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42df300-78ee-4f3c-ac34-38e114500e12 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:50.157333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e84b7-3e97-4c0d-a6bf-3790b529221b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:50.169179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31031a45-dd1b-4d7c-9cb3-dffbe28fe618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:50.170340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31031a45-dd1b-4d7c-9cb3-dffbe28fe618 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:50.170727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31031a45-dd1b-4d7c-9cb3-dffbe28fe618 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:50.171069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31031a45-dd1b-4d7c-9cb3-dffbe28fe618 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:50.172097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31031a45-dd1b-4d7c-9cb3-dffbe28fe618 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:50.172516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31031a45-dd1b-4d7c-9cb3-dffbe28fe618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:50.174261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31031a45-dd1b-4d7c-9cb3-dffbe28fe618 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:50.186544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 376/747] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:50.187675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31031a45-dd1b-4d7c-9cb3-dffbe28fe618 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:50.200746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd8e55-d080-4810-ad8e-077749b88ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:50.201901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd8e55-d080-4810-ad8e-077749b88ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:50.202450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd8e55-d080-4810-ad8e-077749b88ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:50.202959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd8e55-d080-4810-ad8e-077749b88ca3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:50.210822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd8e55-d080-4810-ad8e-077749b88ca3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:50.212669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd8e55-d080-4810-ad8e-077749b88ca3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-12dd8e55-d080-4810-ad8e-077749b88ca3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:50.228362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:50.229389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:50.230358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:50.230358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:50.230358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:50.230358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:50.230358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:50.230358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:50.230358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:50.230358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:50.230358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:50.230358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:50.237322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 372/748] 10.222.0.30 () {56 vars in 1093 bytes} [Mon May 23 17:54:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:50.238494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd8e55-d080-4810-ad8e-077749b88ca3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:50.299931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31031a45-dd1b-4d7c-9cb3-dffbe28fe618 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:50.325495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:50.339502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0ec8c-3c4d-43e5-9239-d0293ba9f007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:50.340471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ec8c-3c4d-43e5-9239-d0293ba9f007 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:50.340609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ec8c-3c4d-43e5-9239-d0293ba9f007 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:50.340822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0ec8c-3c4d-43e5-9239-d0293ba9f007 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:50.341741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0ec8c-3c4d-43e5-9239-d0293ba9f007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:50.341978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0ec8c-3c4d-43e5-9239-d0293ba9f007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:50.343564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0ec8c-3c4d-43e5-9239-d0293ba9f007 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:50.350509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd8e55-d080-4810-ad8e-077749b88ca3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:50.362347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 377/749] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:50.363542 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0ec8c-3c4d-43e5-9239-d0293ba9f007 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:50.370034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:50.390363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a47e9-c693-4e88-affd-86fbe94cc3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:50.391587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a47e9-c693-4e88-affd-86fbe94cc3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:50.392443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a47e9-c693-4e88-affd-86fbe94cc3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:50.392922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a47e9-c693-4e88-affd-86fbe94cc3a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:50.405149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a47e9-c693-4e88-affd-86fbe94cc3a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:50.409729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a47e9-c693-4e88-affd-86fbe94cc3a6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-537a47e9-c693-4e88-affd-86fbe94cc3a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:50.432843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:50.433968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:50.435050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:50.435050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:50.435050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:50.435050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:50.440528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 373/750] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:50.440528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a47e9-c693-4e88-affd-86fbe94cc3a6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:50.492740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0ec8c-3c4d-43e5-9239-d0293ba9f007 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:50.536508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b32d3-e4dc-4dfa-8d0f-31e65e41ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:50.537193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b32d3-e4dc-4dfa-8d0f-31e65e41ae53 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:50.537480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b32d3-e4dc-4dfa-8d0f-31e65e41ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:50.537758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b32d3-e4dc-4dfa-8d0f-31e65e41ae53 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:50.539032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b32d3-e4dc-4dfa-8d0f-31e65e41ae53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:50.539355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b32d3-e4dc-4dfa-8d0f-31e65e41ae53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:50.541706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b32d3-e4dc-4dfa-8d0f-31e65e41ae53 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:50.565044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a47e9-c693-4e88-affd-86fbe94cc3a6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:50.569079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 378/751] 10.222.0.30 () {56 vars in 1133 bytes} [Mon May 23 17:54:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:50.570000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b32d3-e4dc-4dfa-8d0f-31e65e41ae53 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:50.612602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde314a8-7769-4fc4-9e9f-f51b22a657d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:50.613264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde314a8-7769-4fc4-9e9f-f51b22a657d4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:50.613549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde314a8-7769-4fc4-9e9f-f51b22a657d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:50.613827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde314a8-7769-4fc4-9e9f-f51b22a657d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:50.614657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde314a8-7769-4fc4-9e9f-f51b22a657d4 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=fcbd7035e027494cb063489b375cb385) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:50.614997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde314a8-7769-4fc4-9e9f-f51b22a657d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:50.616664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde314a8-7769-4fc4-9e9f-f51b22a657d4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:50.624345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 374/752] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:50 2022] GET /identity/v3/role_assignments?user.id=fcbd7035e027494cb063489b375cb385&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=af8084c48e3c40298e26d44d6d14595a => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:50.624872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde314a8-7769-4fc4-9e9f-f51b22a657d4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:50.632724 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:50.660555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:50.702090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b32d3-e4dc-4dfa-8d0f-31e65e41ae53 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:50.739086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7125d9-5dea-4a91-af2d-b641445963e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:50.740139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7125d9-5dea-4a91-af2d-b641445963e7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:50.740642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7125d9-5dea-4a91-af2d-b641445963e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:50.741127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7125d9-5dea-4a91-af2d-b641445963e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:50.742157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7125d9-5dea-4a91-af2d-b641445963e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:50.742678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7125d9-5dea-4a91-af2d-b641445963e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:50.744427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7125d9-5dea-4a91-af2d-b641445963e7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:50.744721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde314a8-7769-4fc4-9e9f-f51b22a657d4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:50.773225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 379/753] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:50.779707 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7125d9-5dea-4a91-af2d-b641445963e7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:50.785949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4fca5-5a38-4ee2-9aed-c24febbf6d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:50.786190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4fca5-5a38-4ee2-9aed-c24febbf6d20 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:50.786549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4fca5-5a38-4ee2-9aed-c24febbf6d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:50.790575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4fca5-5a38-4ee2-9aed-c24febbf6d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:50.802742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4fca5-5a38-4ee2-9aed-c24febbf6d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:50.804402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4fca5-5a38-4ee2-9aed-c24febbf6d20 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-33c4fca5-5a38-4ee2-9aed-c24febbf6d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:50.824988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:50.826091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:50.827085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:50.827085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:50.827085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:50.827085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:50.827949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 375/754] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:50.833655 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4fca5-5a38-4ee2-9aed-c24febbf6d20 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:50.947201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:50.969982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4fca5-5a38-4ee2-9aed-c24febbf6d20 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:51.009155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:51.019664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7125d9-5dea-4a91-af2d-b641445963e7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:51.022359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347bbbc-ac86-4224-88ad-09c9cea590a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:51.023564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347bbbc-ac86-4224-88ad-09c9cea590a3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.023564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347bbbc-ac86-4224-88ad-09c9cea590a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.023886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347bbbc-ac86-4224-88ad-09c9cea590a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.025230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347bbbc-ac86-4224-88ad-09c9cea590a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:51.030720 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347bbbc-ac86-4224-88ad-09c9cea590a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:51.030720 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347bbbc-ac86-4224-88ad-09c9cea590a3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:51.045837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 376/755] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:51.045837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347bbbc-ac86-4224-88ad-09c9cea590a3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:51.070311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58aae-beff-4b30-9030-71db9d8b40c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:51.072119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58aae-beff-4b30-9030-71db9d8b40c3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.072608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58aae-beff-4b30-9030-71db9d8b40c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.073076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58aae-beff-4b30-9030-71db9d8b40c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.081597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e58aae-beff-4b30-9030-71db9d8b40c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:51.083352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e58aae-beff-4b30-9030-71db9d8b40c3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-93e58aae-beff-4b30-9030-71db9d8b40c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:51.098849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:51.099817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:51.100820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:51.100820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:51.100820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:51.100820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:51.100820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:51.100820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:51.100820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:51.100820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:51.100820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:54:51.100820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:51.103761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 380/756] 10.222.0.30 () {56 vars in 1117 bytes} [Mon May 23 17:54:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:51.109366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58aae-beff-4b30-9030-71db9d8b40c3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:51.217413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58aae-beff-4b30-9030-71db9d8b40c3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:51.226422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347bbbc-ac86-4224-88ad-09c9cea590a3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:51.258142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71640e-c4dd-496f-8e36-cdb44662bff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:51.259717 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71640e-c4dd-496f-8e36-cdb44662bff9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.260230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71640e-c4dd-496f-8e36-cdb44662bff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.260700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71640e-c4dd-496f-8e36-cdb44662bff9 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.261790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71640e-c4dd-496f-8e36-cdb44662bff9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:51.262310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71640e-c4dd-496f-8e36-cdb44662bff9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:51.264041 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71640e-c4dd-496f-8e36-cdb44662bff9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:51.283971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 381/757] 10.222.0.30 () {56 vars in 1149 bytes} [Mon May 23 17:54:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:51.289862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71640e-c4dd-496f-8e36-cdb44662bff9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:51.304627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb984891-b2bb-4f90-9762-e268544915ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:51.305303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb984891-b2bb-4f90-9762-e268544915ee None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.305589 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb984891-b2bb-4f90-9762-e268544915ee None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.306440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb984891-b2bb-4f90-9762-e268544915ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.313305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:51.316097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb984891-b2bb-4f90-9762-e268544915ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:51.317562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb984891-b2bb-4f90-9762-e268544915ee None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-eb984891-b2bb-4f90-9762-e268544915ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:51.353148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:51.354090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:51.355005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:51.355005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:51.355005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:51.355005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:51.355005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:51.355005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:51.355005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:51.355005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:51.361360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 377/758] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:51.362262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb984891-b2bb-4f90-9762-e268544915ee None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:51.372897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:51.402821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71640e-c4dd-496f-8e36-cdb44662bff9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:51.438586 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab959a-1673-43d5-be83-26d65711b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:51.439591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab959a-1673-43d5-be83-26d65711b74c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.440071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab959a-1673-43d5-be83-26d65711b74c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.440571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab959a-1673-43d5-be83-26d65711b74c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.519711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab959a-1673-43d5-be83-26d65711b74c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:51.523436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab959a-1673-43d5-be83-26d65711b74c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:51.525583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb984891-b2bb-4f90-9762-e268544915ee None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:51.543395 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:51.571258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d058f10-782e-46ee-9ad0-0047e2d00313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:51.572528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d058f10-782e-46ee-9ad0-0047e2d00313 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.573011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d058f10-782e-46ee-9ad0-0047e2d00313 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.573571 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d058f10-782e-46ee-9ad0-0047e2d00313 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.574181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d058f10-782e-46ee-9ad0-0047e2d00313 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:51.574501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d058f10-782e-46ee-9ad0-0047e2d00313 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:51.576019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d058f10-782e-46ee-9ad0-0047e2d00313 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:51.594679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 378/759] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:51.596195 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12627b35-be6b-46bf-a869-2af876581cc5 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.596493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12627b35-be6b-46bf-a869-2af876581cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.596774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12627b35-be6b-46bf-a869-2af876581cc5 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.598415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 379/760] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:51.599325 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12627b35-be6b-46bf-a869-2af876581cc5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:51.639141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 382/761] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 17:54:51.645182 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256605-853a-40f8-879c-50b3fb4bc06a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.645743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256605-853a-40f8-879c-50b3fb4bc06a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.646266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49256605-853a-40f8-879c-50b3fb4bc06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.664418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-49256605-853a-40f8-879c-50b3fb4bc06a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:51.666500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-49256605-853a-40f8-879c-50b3fb4bc06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:51.668987 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:51.710882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12627b35-be6b-46bf-a869-2af876581cc5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:51.741866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 383/762] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:54:51.743678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49256605-853a-40f8-879c-50b3fb4bc06a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:51.748944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76ec53-4fca-4761-9b05-80fdf632d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:51.749886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76ec53-4fca-4761-9b05-80fdf632d14e None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.750176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76ec53-4fca-4761-9b05-80fdf632d14e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.750454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76ec53-4fca-4761-9b05-80fdf632d14e None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/9021e2249e11489083139e210562ce44/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.752608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76ec53-4fca-4761-9b05-80fdf632d14e None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=9021e2249e11489083139e210562ce44, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:51.754211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76ec53-4fca-4761-9b05-80fdf632d14e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:51.780835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 380/763] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:54:51 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/9021e2249e11489083139e210562ce44/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:51.781681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76ec53-4fca-4761-9b05-80fdf632d14e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:51.799536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:51.859282 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49256605-853a-40f8-879c-50b3fb4bc06a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:51.898223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593337b-619f-4fe9-8ed6-7a88f7f0ee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:51.900359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593337b-619f-4fe9-8ed6-7a88f7f0ee7d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.901477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593337b-619f-4fe9-8ed6-7a88f7f0ee7d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.902243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593337b-619f-4fe9-8ed6-7a88f7f0ee7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.911519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76ec53-4fca-4761-9b05-80fdf632d14e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:51.914452 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593337b-619f-4fe9-8ed6-7a88f7f0ee7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:51.916790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593337b-619f-4fe9-8ed6-7a88f7f0ee7d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:51.938353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e593337b-619f-4fe9-8ed6-7a88f7f0ee7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:51.938843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:51.939699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:51.940588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:51.940588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:51.940588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:51.940588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:51.943606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 384/764] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:51.949996 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593337b-619f-4fe9-8ed6-7a88f7f0ee7d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:51.953145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95ad60-f0cb-4662-921f-e30e51d29cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:51.954141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95ad60-f0cb-4662-921f-e30e51d29cfd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:51.954434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95ad60-f0cb-4662-921f-e30e51d29cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:51.955637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95ad60-f0cb-4662-921f-e30e51d29cfd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:51.955637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95ad60-f0cb-4662-921f-e30e51d29cfd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:51.956988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95ad60-f0cb-4662-921f-e30e51d29cfd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-0a95ad60-f0cb-4662-921f-e30e51d29cfd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:51.971041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:51.972063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:51.972909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 381/765] 10.222.0.30 () {56 vars in 1129 bytes} [Mon May 23 17:54:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:51.979596 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95ad60-f0cb-4662-921f-e30e51d29cfd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:52.066755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:52.070210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593337b-619f-4fe9-8ed6-7a88f7f0ee7d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:52.109800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95ad60-f0cb-4662-921f-e30e51d29cfd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:52.131442 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ea5fe-a4cd-4a0d-b51d-1b1f73e85e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:52.132438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ea5fe-a4cd-4a0d-b51d-1b1f73e85e6c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:52.132894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ea5fe-a4cd-4a0d-b51d-1b1f73e85e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:52.133609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ea5fe-a4cd-4a0d-b51d-1b1f73e85e6c None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:52.134440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ea5fe-a4cd-4a0d-b51d-1b1f73e85e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:52.138795 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ea5fe-a4cd-4a0d-b51d-1b1f73e85e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:52.140231 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ea5fe-a4cd-4a0d-b51d-1b1f73e85e6c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:52.153287 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 385/766] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:52.153654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfcc5-d350-497e-a85b-fb239c62c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:52.154336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfcc5-d350-497e-a85b-fb239c62c861 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:52.154625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfcc5-d350-497e-a85b-fb239c62c861 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:52.154970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfcc5-d350-497e-a85b-fb239c62c861 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:52.155691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dfcc5-d350-497e-a85b-fb239c62c861 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:52.156002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dfcc5-d350-497e-a85b-fb239c62c861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:52.157384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dfcc5-d350-497e-a85b-fb239c62c861 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:52.161218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ea5fe-a4cd-4a0d-b51d-1b1f73e85e6c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:52.162480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 382/767] 10.222.0.30 () {56 vars in 1124 bytes} [Mon May 23 17:54:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:52.168748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfcc5-d350-497e-a85b-fb239c62c861 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:52.263077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:52.308855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ea5fe-a4cd-4a0d-b51d-1b1f73e85e6c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:52.333524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfcc5-d350-497e-a85b-fb239c62c861 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:52.371497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7009b-0e8a-49f6-96fe-6acfcf42d426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:52.372655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7009b-0e8a-49f6-96fe-6acfcf42d426 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:52.373143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7009b-0e8a-49f6-96fe-6acfcf42d426 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:52.373622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7009b-0e8a-49f6-96fe-6acfcf42d426 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:52.381441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7009b-0e8a-49f6-96fe-6acfcf42d426 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:52.383611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7009b-0e8a-49f6-96fe-6acfcf42d426 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:52.384894 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8523e08-64fb-4bea-aae7-938b44d9a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:52.385612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8523e08-64fb-4bea-aae7-938b44d9a626 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:52.385904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8523e08-64fb-4bea-aae7-938b44d9a626 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:52.386176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8523e08-64fb-4bea-aae7-938b44d9a626 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:52.386904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8523e08-64fb-4bea-aae7-938b44d9a626 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:52.387228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8523e08-64fb-4bea-aae7-938b44d9a626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:52.388555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8523e08-64fb-4bea-aae7-938b44d9a626 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-c1c7009b-0e8a-49f6-96fe-6acfcf42d426 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:52.400922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:52.401859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:52.402824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:52.402824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:52.402824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:52.402824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:52.402824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:52.402824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:52.402824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:52.402824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:52.403267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 383/768] 10.222.0.30 () {56 vars in 1124 bytes} [Mon May 23 17:54:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:52.405387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 386/769] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:52.411020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7009b-0e8a-49f6-96fe-6acfcf42d426 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:52.411144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8523e08-64fb-4bea-aae7-938b44d9a626 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:52.449382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:52.560422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7009b-0e8a-49f6-96fe-6acfcf42d426 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:52.562180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8523e08-64fb-4bea-aae7-938b44d9a626 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:52.584151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:52.597511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c2711-b2d8-40d7-a279-b0cc78234d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:52.598175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c2711-b2d8-40d7-a279-b0cc78234d64 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:52.598469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c2711-b2d8-40d7-a279-b0cc78234d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:52.598750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c2711-b2d8-40d7-a279-b0cc78234d64 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:52.599538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c2711-b2d8-40d7-a279-b0cc78234d64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:52.599912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c2711-b2d8-40d7-a279-b0cc78234d64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:52.601488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c2711-b2d8-40d7-a279-b0cc78234d64 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:52.609056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc74ad-77ab-4bea-9481-ddf7da57dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:52.610360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc74ad-77ab-4bea-9481-ddf7da57dd73 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:52.610946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc74ad-77ab-4bea-9481-ddf7da57dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:52.611838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc74ad-77ab-4bea-9481-ddf7da57dd73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:52.613052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc74ad-77ab-4bea-9481-ddf7da57dd73 None admin] RBAC: Adding query filter params (interface=public, service_id=44be1953cb674eb58e9418228baa2f81, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:52.613443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc74ad-77ab-4bea-9481-ddf7da57dd73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:52.615091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 387/770] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:52.616467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f8d5d-a382-447e-8be1-808e05a4cbea None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:52.616811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f8d5d-a382-447e-8be1-808e05a4cbea None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:52.617097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f8d5d-a382-447e-8be1-808e05a4cbea None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:52.618953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc74ad-77ab-4bea-9481-ddf7da57dd73 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:52.619205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 388/771] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:52.620418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f8d5d-a382-447e-8be1-808e05a4cbea None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:52.634472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 384/772] 10.222.0.30 () {56 vars in 1251 bytes} [Mon May 23 17:54:52 2022] GET /identity/v3/endpoints?service_id=44be1953cb674eb58e9418228baa2f81&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:52.640397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0e3b5-0a6f-403b-9721-a98ad6aaf0c6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:52.640773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0e3b5-0a6f-403b-9721-a98ad6aaf0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:52.641181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0e3b5-0a6f-403b-9721-a98ad6aaf0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:52.659163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8cf0e3b5-0a6f-403b-9721-a98ad6aaf0c6 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:52.660381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8cf0e3b5-0a6f-403b-9721-a98ad6aaf0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:52.722736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:52.746792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 385/773] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:54:52.747868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0e3b5-0a6f-403b-9721-a98ad6aaf0c6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:52.751951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f8d5d-a382-447e-8be1-808e05a4cbea None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:52.805230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5199919-2d63-4d77-985b-295cd0435d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:52.806312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5199919-2d63-4d77-985b-295cd0435d4d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:52.806670 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5199919-2d63-4d77-985b-295cd0435d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:52.806922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5199919-2d63-4d77-985b-295cd0435d4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:52.808469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5199919-2d63-4d77-985b-295cd0435d4d None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=3170dcaf527b44b8bd33cae78b39fb2f) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:52.808792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5199919-2d63-4d77-985b-295cd0435d4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:52.810416 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5199919-2d63-4d77-985b-295cd0435d4d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:52.823242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 389/774] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:52 2022] GET /identity/v3/role_assignments?user.id=3170dcaf527b44b8bd33cae78b39fb2f&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:52.824334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5199919-2d63-4d77-985b-295cd0435d4d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:52.922473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0e3b5-0a6f-403b-9721-a98ad6aaf0c6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:52.946930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:53.001088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666f4ec-e41b-4e6c-9a76-b7861049124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:53.001781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666f4ec-e41b-4e6c-9a76-b7861049124e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:53.002111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666f4ec-e41b-4e6c-9a76-b7861049124e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:53.002393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666f4ec-e41b-4e6c-9a76-b7861049124e None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:53.003121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666f4ec-e41b-4e6c-9a76-b7861049124e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:53.004625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666f4ec-e41b-4e6c-9a76-b7861049124e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:53.011872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 386/775] 10.222.0.30 () {56 vars in 1087 bytes} [Mon May 23 17:54:52 2022] GET /identity/v3/services => generated 772 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:53.049362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5199919-2d63-4d77-985b-295cd0435d4d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:53.091160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226772c-cdc7-443a-82f3-c55224f5bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:53.092110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226772c-cdc7-443a-82f3-c55224f5bbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:53.092399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226772c-cdc7-443a-82f3-c55224f5bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:53.092677 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226772c-cdc7-443a-82f3-c55224f5bbf3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:53.093355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226772c-cdc7-443a-82f3-c55224f5bbf3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:53.094811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226772c-cdc7-443a-82f3-c55224f5bbf3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-f226772c-cdc7-443a-82f3-c55224f5bbf3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:53.109093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:53.110142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:53.111467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 390/776] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:52 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:53.116818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666f4ec-e41b-4e6c-9a76-b7861049124e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:53.261135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666f4ec-e41b-4e6c-9a76-b7861049124e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:53.304502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09b786-1d8d-4f60-ae41-921dee685ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:53.305248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b786-1d8d-4f60-ae41-921dee685ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:53.305450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b786-1d8d-4f60-ae41-921dee685ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:53.306216 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b786-1d8d-4f60-ae41-921dee685ee3 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:53.307159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09b786-1d8d-4f60-ae41-921dee685ee3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:53.307470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09b786-1d8d-4f60-ae41-921dee685ee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:53.308870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09b786-1d8d-4f60-ae41-921dee685ee3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:53.314143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 387/777] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:54:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:53.319383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226772c-cdc7-443a-82f3-c55224f5bbf3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:53.334769 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:53.402127 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e641-5f6d-4972-909c-8749e4947bb5 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:53.402653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e641-5f6d-4972-909c-8749e4947bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:53.407314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e641-5f6d-4972-909c-8749e4947bb5 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:53.408916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 388/778] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:54:53.414387 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a5c6-6044-4aab-84dc-eee060802389 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:53.414684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a5c6-6044-4aab-84dc-eee060802389 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:53.415026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a5c6-6044-4aab-84dc-eee060802389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:53.447918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1cb3a5c6-6044-4aab-84dc-eee060802389 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:53.451234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1cb3a5c6-6044-4aab-84dc-eee060802389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:53.467250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226772c-cdc7-443a-82f3-c55224f5bbf3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:53.520136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:53.547767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ae3bd-dedd-4f8a-a32b-00d5510695d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:53.548441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ae3bd-dedd-4f8a-a32b-00d5510695d0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:53.548714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ae3bd-dedd-4f8a-a32b-00d5510695d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:53.548995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ae3bd-dedd-4f8a-a32b-00d5510695d0 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:53.549708 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ae3bd-dedd-4f8a-a32b-00d5510695d0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:53.550016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ae3bd-dedd-4f8a-a32b-00d5510695d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:53.551426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ae3bd-dedd-4f8a-a32b-00d5510695d0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:53.562718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 391/779] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:54:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:53.570202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ae3bd-dedd-4f8a-a32b-00d5510695d0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:53.589527 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 389/780] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:54:53.612505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a5c6-6044-4aab-84dc-eee060802389 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:53.716190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a5c6-6044-4aab-84dc-eee060802389 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:53.716716 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:53.743027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ae3bd-dedd-4f8a-a32b-00d5510695d0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:53.752363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefdd85-a8ab-4a37-895a-c74b599377e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:53.753335 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefdd85-a8ab-4a37-895a-c74b599377e6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:53.753722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefdd85-a8ab-4a37-895a-c74b599377e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:53.754067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefdd85-a8ab-4a37-895a-c74b599377e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:53.766864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefdd85-a8ab-4a37-895a-c74b599377e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5cefdd85-a8ab-4a37-895a-c74b599377e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:53.776125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:53.777117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:53.777975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 390/781] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:53.783904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefdd85-a8ab-4a37-895a-c74b599377e6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:53.820841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:53.839435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d452e1-65b7-4af9-9f89-736f2743104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:53.840222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d452e1-65b7-4af9-9f89-736f2743104f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:53.840588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d452e1-65b7-4af9-9f89-736f2743104f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:53.840933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d452e1-65b7-4af9-9f89-736f2743104f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:53.841810 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d452e1-65b7-4af9-9f89-736f2743104f None admin] RBAC: Adding query filter params (interface=public, service_id=f6c67718887142d4907fcef4019815d4, region_id=RegionOne) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:53.842190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d452e1-65b7-4af9-9f89-736f2743104f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:53.843660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d452e1-65b7-4af9-9f89-736f2743104f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:53.860361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 392/782] 10.222.0.30 () {56 vars in 1251 bytes} [Mon May 23 17:54:53 2022] GET /identity/v3/endpoints?service_id=f6c67718887142d4907fcef4019815d4&interface=public®ion_id=RegionOne => generated 194 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:53.866107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d452e1-65b7-4af9-9f89-736f2743104f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:53.896708 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefdd85-a8ab-4a37-895a-c74b599377e6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:53.936358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce427c9-b3b1-4a1c-8ce8-5e36e92f5587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:53.937058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce427c9-b3b1-4a1c-8ce8-5e36e92f5587 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:53.937339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce427c9-b3b1-4a1c-8ce8-5e36e92f5587 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:53.937613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce427c9-b3b1-4a1c-8ce8-5e36e92f5587 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:53.938363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce427c9-b3b1-4a1c-8ce8-5e36e92f5587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:53.938666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce427c9-b3b1-4a1c-8ce8-5e36e92f5587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:53.940309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce427c9-b3b1-4a1c-8ce8-5e36e92f5587 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:53.950450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 391/783] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:53.956126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce427c9-b3b1-4a1c-8ce8-5e36e92f5587 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:54.091172 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:54.105140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce427c9-b3b1-4a1c-8ce8-5e36e92f5587 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:54.126580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d452e1-65b7-4af9-9f89-736f2743104f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:54.173017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff21be6-0f1c-4b8f-9d98-ad1af7c8f449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:54.173825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21be6-0f1c-4b8f-9d98-ad1af7c8f449 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:54.174110 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21be6-0f1c-4b8f-9d98-ad1af7c8f449 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:54.174387 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21be6-0f1c-4b8f-9d98-ad1af7c8f449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:54.192879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff21be6-0f1c-4b8f-9d98-ad1af7c8f449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:54.194358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff21be6-0f1c-4b8f-9d98-ad1af7c8f449 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:54.196977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4283-ef89-4381-ac40-2ed7602e76bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:54.197648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4283-ef89-4381-ac40-2ed7602e76bc None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:54.197930 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4283-ef89-4381-ac40-2ed7602e76bc None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:54.198204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4283-ef89-4381-ac40-2ed7602e76bc None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:54.198906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4283-ef89-4381-ac40-2ed7602e76bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:54.200258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4283-ef89-4381-ac40-2ed7602e76bc None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:54.203015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:54.212415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 393/784] 10.222.0.30 () {56 vars in 1087 bytes} [Mon May 23 17:54:53 2022] GET /identity/v3/services => generated 772 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-9ff21be6-0f1c-4b8f-9d98-ad1af7c8f449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:54.223578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:54.224557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:54.225458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:54.225458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:54.225458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:54.225458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:54.225458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 392/785] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:54.231681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4283-ef89-4381-ac40-2ed7602e76bc None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:54.410155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4283-ef89-4381-ac40-2ed7602e76bc None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:54.460424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56d58e-152a-4bf0-a18f-a0b86bb3ac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:54.461520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56d58e-152a-4bf0-a18f-a0b86bb3ac64 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:54.462108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56d58e-152a-4bf0-a18f-a0b86bb3ac64 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:54.462618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56d58e-152a-4bf0-a18f-a0b86bb3ac64 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:54.463578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56d58e-152a-4bf0-a18f-a0b86bb3ac64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:54.464103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56d58e-152a-4bf0-a18f-a0b86bb3ac64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:54.465684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56d58e-152a-4bf0-a18f-a0b86bb3ac64 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:54.486243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 394/786] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:54.491522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56d58e-152a-4bf0-a18f-a0b86bb3ac64 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:54.492466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb89f4-b930-49af-bc7f-7ea972f0ce34 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:54.493848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb89f4-b930-49af-bc7f-7ea972f0ce34 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:54.494331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb89f4-b930-49af-bc7f-7ea972f0ce34 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:54.496215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 393/787] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:54.515324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3531ba-c205-453c-b90e-af25c0e11e23 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:54.515973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3531ba-c205-453c-b90e-af25c0e11e23 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:54.516457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3531ba-c205-453c-b90e-af25c0e11e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:54.559087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:54.563627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-fb3531ba-c205-453c-b90e-af25c0e11e23 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:54.565213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fb3531ba-c205-453c-b90e-af25c0e11e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:54.602049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56d58e-152a-4bf0-a18f-a0b86bb3ac64 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:54.639075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30367ddc-038a-47f9-898d-b75a4bc2b2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:54.639413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367ddc-038a-47f9-898d-b75a4bc2b2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:54.639690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367ddc-038a-47f9-898d-b75a4bc2b2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:54.639962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367ddc-038a-47f9-898d-b75a4bc2b2e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:54.647552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30367ddc-038a-47f9-898d-b75a4bc2b2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:54.648996 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30367ddc-038a-47f9-898d-b75a4bc2b2e6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-30367ddc-038a-47f9-898d-b75a4bc2b2e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:54.664173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:54.665376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:54.666436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 395/788] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:54.672058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30367ddc-038a-47f9-898d-b75a4bc2b2e6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:54.683984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 394/789] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:54:54.716271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3531ba-c205-453c-b90e-af25c0e11e23 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:54.828459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:54.848933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30367ddc-038a-47f9-898d-b75a4bc2b2e6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:54.885709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:54.888326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3531ba-c205-453c-b90e-af25c0e11e23 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:54.935570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bb8bc-89a6-485e-b35d-0025b551f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:54.936145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bb8bc-89a6-485e-b35d-0025b551f9eb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:54.936428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bb8bc-89a6-485e-b35d-0025b551f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:54.936703 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bb8bc-89a6-485e-b35d-0025b551f9eb None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:54.937556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bb8bc-89a6-485e-b35d-0025b551f9eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:54.937868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bb8bc-89a6-485e-b35d-0025b551f9eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:54.942752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bb8bc-89a6-485e-b35d-0025b551f9eb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:54.953785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f749c3-b335-4288-bb22-0d5d3c8365d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:54.954889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f749c3-b335-4288-bb22-0d5d3c8365d3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:54.955315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f749c3-b335-4288-bb22-0d5d3c8365d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:54.955778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f749c3-b335-4288-bb22-0d5d3c8365d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:54.970949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 396/790] 10.222.0.30 () {56 vars in 1135 bytes} [Mon May 23 17:54:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:54.978512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bb8bc-89a6-485e-b35d-0025b551f9eb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:54.982247 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f749c3-b335-4288-bb22-0d5d3c8365d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b5f749c3-b335-4288-bb22-0d5d3c8365d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:54.991979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:54.993215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:54.994637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:54.997033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 395/791] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:55.006721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f749c3-b335-4288-bb22-0d5d3c8365d3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:55.166834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f749c3-b335-4288-bb22-0d5d3c8365d3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:55.184886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bb8bc-89a6-485e-b35d-0025b551f9eb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:55.201756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:55.211166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095d46f-9b92-49f1-9783-4a279edbc461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:55.212246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095d46f-9b92-49f1-9783-4a279edbc461 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.212724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095d46f-9b92-49f1-9783-4a279edbc461 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.213173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095d46f-9b92-49f1-9783-4a279edbc461 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.214101 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095d46f-9b92-49f1-9783-4a279edbc461 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:55.216085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095d46f-9b92-49f1-9783-4a279edbc461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:55.217675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095d46f-9b92-49f1-9783-4a279edbc461 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:55.239374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 396/792] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:55.243174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095d46f-9b92-49f1-9783-4a279edbc461 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:55.287687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a963360-7287-4cf9-8804-8d3ee2eb4f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:55.288358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a963360-7287-4cf9-8804-8d3ee2eb4f85 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.288638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a963360-7287-4cf9-8804-8d3ee2eb4f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.288908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a963360-7287-4cf9-8804-8d3ee2eb4f85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.312701 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a963360-7287-4cf9-8804-8d3ee2eb4f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:55.314183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a963360-7287-4cf9-8804-8d3ee2eb4f85 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1a963360-7287-4cf9-8804-8d3ee2eb4f85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:55.355311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:55.356292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:55.357190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:55.357190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:55.357190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:55.357190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:55.361207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095d46f-9b92-49f1-9783-4a279edbc461 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:55.363041 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 397/793] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:55.364655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a963360-7287-4cf9-8804-8d3ee2eb4f85 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:55.400622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73570198-fa62-4952-955c-fd73276bf1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:55.401883 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73570198-fa62-4952-955c-fd73276bf1bd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.402346 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73570198-fa62-4952-955c-fd73276bf1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.402830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73570198-fa62-4952-955c-fd73276bf1bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.418128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:55.435672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73570198-fa62-4952-955c-fd73276bf1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:55.437253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73570198-fa62-4952-955c-fd73276bf1bd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-73570198-fa62-4952-955c-fd73276bf1bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:55.470806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:55.471765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:55.472908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:55.472908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:55.472908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:55.472908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:55.472908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 397/794] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:55.480466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73570198-fa62-4952-955c-fd73276bf1bd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:55.541879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a963360-7287-4cf9-8804-8d3ee2eb4f85 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:55.553108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:55.588897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ae34-e0c3-4af7-bd76-b2aba1efb822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:55.589758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ae34-e0c3-4af7-bd76-b2aba1efb822 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.590940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ae34-e0c3-4af7-bd76-b2aba1efb822 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.591351 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ae34-e0c3-4af7-bd76-b2aba1efb822 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.592251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ae34-e0c3-4af7-bd76-b2aba1efb822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:55.592672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ae34-e0c3-4af7-bd76-b2aba1efb822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:55.595039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ae34-e0c3-4af7-bd76-b2aba1efb822 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:55.612913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 398/795] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:55.612913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388a249-b39c-49d2-a2d8-741c33cab432 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.615326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388a249-b39c-49d2-a2d8-741c33cab432 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.615326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388a249-b39c-49d2-a2d8-741c33cab432 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.615326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 399/796] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:55.617347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388a249-b39c-49d2-a2d8-741c33cab432 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:55.632814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73570198-fa62-4952-955c-fd73276bf1bd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:55.676815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd96643-fb26-4ab6-8893-c7350fbd1492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:55.677478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96643-fb26-4ab6-8893-c7350fbd1492 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.678165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96643-fb26-4ab6-8893-c7350fbd1492 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.678442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96643-fb26-4ab6-8893-c7350fbd1492 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.679459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd96643-fb26-4ab6-8893-c7350fbd1492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:55.679766 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd96643-fb26-4ab6-8893-c7350fbd1492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:55.682423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd96643-fb26-4ab6-8893-c7350fbd1492 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:55.699107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 398/797] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:55.701016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405573c-1162-4d13-8d3e-3d979a6c38a4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.701304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405573c-1162-4d13-8d3e-3d979a6c38a4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.701577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405573c-1162-4d13-8d3e-3d979a6c38a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.717185 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:55.725948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5405573c-1162-4d13-8d3e-3d979a6c38a4 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:55.727855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5405573c-1162-4d13-8d3e-3d979a6c38a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:55.729411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388a249-b39c-49d2-a2d8-741c33cab432 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:55.768506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b5567-b01c-4a1b-aafc-769863d41370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:55.769513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b5567-b01c-4a1b-aafc-769863d41370 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.769894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b5567-b01c-4a1b-aafc-769863d41370 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.770287 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b5567-b01c-4a1b-aafc-769863d41370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.778960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b5567-b01c-4a1b-aafc-769863d41370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:55.780860 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b5567-b01c-4a1b-aafc-769863d41370 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-746b5567-b01c-4a1b-aafc-769863d41370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:55.798138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:55.799310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:55.800321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:55.800321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:55.800321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:55.800321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:55.800321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:55.800321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:55.800321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:55.800321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:55.806722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 400/798] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:55.806722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b5567-b01c-4a1b-aafc-769863d41370 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:55.819728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 399/799] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:54:55.821344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8efd3-0120-4709-b712-db4c2a061ba5 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.821976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8efd3-0120-4709-b712-db4c2a061ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.822427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8efd3-0120-4709-b712-db4c2a061ba5 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.824183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 400/800] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:55.825045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8efd3-0120-4709-b712-db4c2a061ba5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:55.865696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:55.917647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b5567-b01c-4a1b-aafc-769863d41370 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:55.936753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8efd3-0120-4709-b712-db4c2a061ba5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:55.954099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4c3f3-4a54-4496-9e35-efead7ed11b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:55.954920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4c3f3-4a54-4496-9e35-efead7ed11b4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.955206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4c3f3-4a54-4496-9e35-efead7ed11b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.955623 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4c3f3-4a54-4496-9e35-efead7ed11b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.963312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4c3f3-4a54-4496-9e35-efead7ed11b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:55.965112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4c3f3-4a54-4496-9e35-efead7ed11b4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:55.977200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1575725-0d40-4a04-a5f7-5ef147975cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:55.978313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1575725-0d40-4a04-a5f7-5ef147975cbd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.978595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1575725-0d40-4a04-a5f7-5ef147975cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.978896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1575725-0d40-4a04-a5f7-5ef147975cbd None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:55.979680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1575725-0d40-4a04-a5f7-5ef147975cbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:55.979988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1575725-0d40-4a04-a5f7-5ef147975cbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:55.981405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1575725-0d40-4a04-a5f7-5ef147975cbd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-09c4c3f3-4a54-4496-9e35-efead7ed11b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:55.984767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:55.986523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:55.988859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 401/801] 10.222.0.30 () {56 vars in 1093 bytes} [Mon May 23 17:54:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:55.990039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386fc1-9900-476c-b325-cfa611ea5efd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:55.990039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386fc1-9900-476c-b325-cfa611ea5efd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:55.990293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386fc1-9900-476c-b325-cfa611ea5efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:56.005832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 401/802] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:56.005832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1575725-0d40-4a04-a5f7-5ef147975cbd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:56.011921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e2386fc1-9900-476c-b325-cfa611ea5efd None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:56.013113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e2386fc1-9900-476c-b325-cfa611ea5efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:56.016992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:56.084583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 402/803] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:54:56.091655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2386fc1-9900-476c-b325-cfa611ea5efd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:56.117107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:56.124713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1575725-0d40-4a04-a5f7-5ef147975cbd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:56.160779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3e846-2dbb-40f0-a915-9de66ea5b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:56.161568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3e846-2dbb-40f0-a915-9de66ea5b200 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:56.161850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3e846-2dbb-40f0-a915-9de66ea5b200 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:56.162122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3e846-2dbb-40f0-a915-9de66ea5b200 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:56.174420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3e846-2dbb-40f0-a915-9de66ea5b200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ced3e846-2dbb-40f0-a915-9de66ea5b200 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:56.183417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:56.184561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 402/804] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:54:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:56.190258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3e846-2dbb-40f0-a915-9de66ea5b200 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:56.211357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2386fc1-9900-476c-b325-cfa611ea5efd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:56.254279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb52f5-a870-4a31-b7b0-7f8532827d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:56.254898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb52f5-a870-4a31-b7b0-7f8532827d21 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:56.255186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb52f5-a870-4a31-b7b0-7f8532827d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:56.255451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb52f5-a870-4a31-b7b0-7f8532827d21 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:56.256273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb52f5-a870-4a31-b7b0-7f8532827d21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:56.256691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb52f5-a870-4a31-b7b0-7f8532827d21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:56.258513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb52f5-a870-4a31-b7b0-7f8532827d21 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:56.268206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:56.283061 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 403/805] 10.222.0.30 () {56 vars in 1133 bytes} [Mon May 23 17:54:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:56.283061 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb52f5-a870-4a31-b7b0-7f8532827d21 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:56.291699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3e846-2dbb-40f0-a915-9de66ea5b200 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:56.329683 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b0d32-53a9-4015-9610-9e14d8ea99b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:56.330577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b0d32-53a9-4015-9610-9e14d8ea99b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:56.330883 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b0d32-53a9-4015-9610-9e14d8ea99b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:56.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b0d32-53a9-4015-9610-9e14d8ea99b1 None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/fcbd7035e027494cb063489b375cb385/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:56.333899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b0d32-53a9-4015-9610-9e14d8ea99b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=fcbd7035e027494cb063489b375cb385, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:56.335370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b0d32-53a9-4015-9610-9e14d8ea99b1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:56.349802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 403/806] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:54:56 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/fcbd7035e027494cb063489b375cb385/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:56.350920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b0d32-53a9-4015-9610-9e14d8ea99b1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:56.378274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:56.414362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb52f5-a870-4a31-b7b0-7f8532827d21 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:56.468060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbc5d3-afae-4ff9-a218-0e4943144798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:56.469009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbc5d3-afae-4ff9-a218-0e4943144798 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:56.469359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbc5d3-afae-4ff9-a218-0e4943144798 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:56.469706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbc5d3-afae-4ff9-a218-0e4943144798 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:56.470857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbc5d3-afae-4ff9-a218-0e4943144798 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:56.472572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbc5d3-afae-4ff9-a218-0e4943144798 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-fbbbc5d3-afae-4ff9-a218-0e4943144798 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:56.489379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:56.490425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 17:54:56.491302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:56.494108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b0d32-53a9-4015-9610-9e14d8ea99b1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:56.496446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 404/807] 10.222.0.30 () {56 vars in 1129 bytes} [Mon May 23 17:54:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:56.497506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbc5d3-afae-4ff9-a218-0e4943144798 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:56.548090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407ec7a-8234-48e2-b32b-1c6e14976756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:56.549212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407ec7a-8234-48e2-b32b-1c6e14976756 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:56.549705 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407ec7a-8234-48e2-b32b-1c6e14976756 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:56.550203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407ec7a-8234-48e2-b32b-1c6e14976756 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:56.551198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407ec7a-8234-48e2-b32b-1c6e14976756 None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:56.551747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407ec7a-8234-48e2-b32b-1c6e14976756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:56.553162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407ec7a-8234-48e2-b32b-1c6e14976756 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:56.562748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 404/808] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:54:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:56.563442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407ec7a-8234-48e2-b32b-1c6e14976756 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:56.570752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:56.622553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbc5d3-afae-4ff9-a218-0e4943144798 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:56.662835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:56.675486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ba79-e8d0-4222-96cb-6b28d8802c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:56.676485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ba79-e8d0-4222-96cb-6b28d8802c23 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:56.677505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ba79-e8d0-4222-96cb-6b28d8802c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:56.677996 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ba79-e8d0-4222-96cb-6b28d8802c23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:56.690369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407ec7a-8234-48e2-b32b-1c6e14976756 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:56.728917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfdfa6-9e26-4da3-8a61-0f4ce91abb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:56.729692 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfdfa6-9e26-4da3-8a61-0f4ce91abb68 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:56.729890 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfdfa6-9e26-4da3-8a61-0f4ce91abb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:56.730171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfdfa6-9e26-4da3-8a61-0f4ce91abb68 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:56.730935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfdfa6-9e26-4da3-8a61-0f4ce91abb68 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:56.731311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfdfa6-9e26-4da3-8a61-0f4ce91abb68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:56.732811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfdfa6-9e26-4da3-8a61-0f4ce91abb68 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:56.738988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 405/809] 10.222.0.30 () {56 vars in 1124 bytes} [Mon May 23 17:54:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:56.739765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfdfa6-9e26-4da3-8a61-0f4ce91abb68 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:56.784612 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ba79-e8d0-4222-96cb-6b28d8802c23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:56.786947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ba79-e8d0-4222-96cb-6b28d8802c23 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:56.858378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:56.871607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfdfa6-9e26-4da3-8a61-0f4ce91abb68 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:56.902684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 405/810] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:54:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:54:56.902684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ba79-e8d0-4222-96cb-6b28d8802c23 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:56.920149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556c33-4a9a-45c9-b14a-8a8d3b1c07da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:56.920951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556c33-4a9a-45c9-b14a-8a8d3b1c07da None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:56.921238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556c33-4a9a-45c9-b14a-8a8d3b1c07da None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:56.921516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556c33-4a9a-45c9-b14a-8a8d3b1c07da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:56.933965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91556c33-4a9a-45c9-b14a-8a8d3b1c07da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:56.935820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91556c33-4a9a-45c9-b14a-8a8d3b1c07da None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:56.937921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-91556c33-4a9a-45c9-b14a-8a8d3b1c07da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:56.955847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:56.956787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:56.957688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:56.957688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:56.957688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:56.957688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:56.957688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 406/811] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:56.957976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556c33-4a9a-45c9-b14a-8a8d3b1c07da None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:57.015820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ba79-e8d0-4222-96cb-6b28d8802c23 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:57.055653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46165b-8747-4ea7-8f87-496b14f67b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:57.056238 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46165b-8747-4ea7-8f87-496b14f67b70 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.056536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46165b-8747-4ea7-8f87-496b14f67b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.056997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46165b-8747-4ea7-8f87-496b14f67b70 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.057521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46165b-8747-4ea7-8f87-496b14f67b70 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:57.057830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46165b-8747-4ea7-8f87-496b14f67b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:57.059231 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46165b-8747-4ea7-8f87-496b14f67b70 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:57.069254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 406/812] 10.222.0.30 () {56 vars in 1124 bytes} [Mon May 23 17:54:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:57.069254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9bd6-efaf-4444-a90c-618c86aae300 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.069477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556c33-4a9a-45c9-b14a-8a8d3b1c07da None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:57.069555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9bd6-efaf-4444-a90c-618c86aae300 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.069555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9bd6-efaf-4444-a90c-618c86aae300 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.069555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 407/813] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:54:57.069555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b9bd6-efaf-4444-a90c-618c86aae300 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:57.099380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:57.108941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8542ae-2208-4652-a04e-02d32d6f88cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:57.109735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8542ae-2208-4652-a04e-02d32d6f88cd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.110018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8542ae-2208-4652-a04e-02d32d6f88cd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.110289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8542ae-2208-4652-a04e-02d32d6f88cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.123290 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8542ae-2208-4652-a04e-02d32d6f88cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:57.124750 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8542ae-2208-4652-a04e-02d32d6f88cd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-1f8542ae-2208-4652-a04e-02d32d6f88cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:57.142558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:57.143569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:57.144481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:57.144481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:57.144481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:57.144481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:57.144481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 407/814] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:57.144774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8542ae-2208-4652-a04e-02d32d6f88cd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:57.191659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b9bd6-efaf-4444-a90c-618c86aae300 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:57.195586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:57.229437 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223246cf-9d1b-494f-9ec4-0020b4f311b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:57.230106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223246cf-9d1b-494f-9ec4-0020b4f311b8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.230388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223246cf-9d1b-494f-9ec4-0020b4f311b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.230663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223246cf-9d1b-494f-9ec4-0020b4f311b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.232938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223246cf-9d1b-494f-9ec4-0020b4f311b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:57.232938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223246cf-9d1b-494f-9ec4-0020b4f311b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:57.233146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223246cf-9d1b-494f-9ec4-0020b4f311b8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:57.251512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 408/815] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:57.251512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598af32-c012-458b-9cb9-ff65c9867026 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.251512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598af32-c012-458b-9cb9-ff65c9867026 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.251512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598af32-c012-458b-9cb9-ff65c9867026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.267462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8542ae-2208-4652-a04e-02d32d6f88cd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:57.270339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7598af32-c012-458b-9cb9-ff65c9867026 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:57.271663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7598af32-c012-458b-9cb9-ff65c9867026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:57.305215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9422d6-4856-40a9-ba51-203d6e997423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:57.305955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9422d6-4856-40a9-ba51-203d6e997423 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.306189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9422d6-4856-40a9-ba51-203d6e997423 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.306465 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9422d6-4856-40a9-ba51-203d6e997423 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.307239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9422d6-4856-40a9-ba51-203d6e997423 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:57.308621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9422d6-4856-40a9-ba51-203d6e997423 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:57.331708 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 408/816] 10.222.0.30 () {60 vars in 1144 bytes} [Mon May 23 17:54:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:54:57.332966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9422d6-4856-40a9-ba51-203d6e997423 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:57.349535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 409/817] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:54:57.350919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598af32-c012-458b-9cb9-ff65c9867026 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:57.379854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:57.488735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598af32-c012-458b-9cb9-ff65c9867026 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:57.504657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9422d6-4856-40a9-ba51-203d6e997423 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:57.507130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:57.533960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7ec43-0d84-4e46-bf35-3002b8f439f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:57.535940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7ec43-0d84-4e46-bf35-3002b8f439f8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.535940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7ec43-0d84-4e46-bf35-3002b8f439f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.535940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7ec43-0d84-4e46-bf35-3002b8f439f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.545187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7ec43-0d84-4e46-bf35-3002b8f439f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:57.546664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7ec43-0d84-4e46-bf35-3002b8f439f8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:57.552889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b452-2ec3-4e8b-9f63-99de90c47c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:57.552889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b452-2ec3-4e8b-9f63-99de90c47c7a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.552889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b452-2ec3-4e8b-9f63-99de90c47c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.552889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b452-2ec3-4e8b-9f63-99de90c47c7a None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.554684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b452-2ec3-4e8b-9f63-99de90c47c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:57.554684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b452-2ec3-4e8b-9f63-99de90c47c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:57.556544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b452-2ec3-4e8b-9f63-99de90c47c7a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-3ca7ec43-0d84-4e46-bf35-3002b8f439f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:57.563725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:57.564736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:57.565779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:57.565779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:57.565779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:57.565779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:57.565779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:57.565779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:57.565779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:57.565779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:57.565779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:54:57.565779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:57.566347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 410/818] 10.222.0.30 () {56 vars in 1117 bytes} [Mon May 23 17:54:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:57.566922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7ec43-0d84-4e46-bf35-3002b8f439f8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:57.581265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 409/819] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:57.582153 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b452-2ec3-4e8b-9f63-99de90c47c7a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:57.658723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:57.692886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7ec43-0d84-4e46-bf35-3002b8f439f8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:57.702036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b452-2ec3-4e8b-9f63-99de90c47c7a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:57.730201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f42107-8c74-4d15-b4d9-e1ae0e94d354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:57.731033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f42107-8c74-4d15-b4d9-e1ae0e94d354 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.731418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f42107-8c74-4d15-b4d9-e1ae0e94d354 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.731699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f42107-8c74-4d15-b4d9-e1ae0e94d354 None admin] PATH_INFO: `/v3/services/network` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.732457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f42107-8c74-4d15-b4d9-e1ae0e94d354 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:57.733836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f42107-8c74-4d15-b4d9-e1ae0e94d354 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:57.736993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95aebd-d1df-4818-b2c9-963403e35233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:57.737742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95aebd-d1df-4818-b2c9-963403e35233 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.738100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95aebd-d1df-4818-b2c9-963403e35233 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.738452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95aebd-d1df-4818-b2c9-963403e35233 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.739485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95aebd-d1df-4818-b2c9-963403e35233 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:57.739904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95aebd-d1df-4818-b2c9-963403e35233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:57.741405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95aebd-d1df-4818-b2c9-963403e35233 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e2f42107-8c74-4d15-b4d9-e1ae0e94d354 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:57.746629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:57.747713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:57.748568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 411/820] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:57 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:57.749947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f42107-8c74-4d15-b4d9-e1ae0e94d354 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:57.761548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 410/821] 10.222.0.30 () {56 vars in 1149 bytes} [Mon May 23 17:54:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:57.762472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95aebd-d1df-4818-b2c9-963403e35233 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:57.791105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:57.866916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f42107-8c74-4d15-b4d9-e1ae0e94d354 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:57.867244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95aebd-d1df-4818-b2c9-963403e35233 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:57.903170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3518ca-c127-486e-a7bf-fee21f1dae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:57.904025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3518ca-c127-486e-a7bf-fee21f1dae95 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.904411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3518ca-c127-486e-a7bf-fee21f1dae95 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.904788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3518ca-c127-486e-a7bf-fee21f1dae95 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.905594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3518ca-c127-486e-a7bf-fee21f1dae95 None admin] RBAC: Adding query filter params (name=network) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:57.906006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3518ca-c127-486e-a7bf-fee21f1dae95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:57.906151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6b802-bfeb-481f-aed2-6c9df73bf3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:57.906975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6b802-bfeb-481f-aed2-6c9df73bf3eb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:57.907257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6b802-bfeb-481f-aed2-6c9df73bf3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:57.907532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6b802-bfeb-481f-aed2-6c9df73bf3eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:57.907899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3518ca-c127-486e-a7bf-fee21f1dae95 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:57.910289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:57.917459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 411/822] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:54:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:57.917459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3518ca-c127-486e-a7bf-fee21f1dae95 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:57.921344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6b802-bfeb-481f-aed2-6c9df73bf3eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:57.923019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6b802-bfeb-481f-aed2-6c9df73bf3eb None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-8eb6b802-bfeb-481f-aed2-6c9df73bf3eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:57.938747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:57.939687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:57.940581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:57.940581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:57.940581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:57.940581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:57.940581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:57.940581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:57.940581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:57.940581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:57.942814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 412/823] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:57.943834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6b802-bfeb-481f-aed2-6c9df73bf3eb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:58.007200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:58.025463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3518ca-c127-486e-a7bf-fee21f1dae95 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:58.056689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6b802-bfeb-481f-aed2-6c9df73bf3eb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:58.061433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801db12-2ee3-4179-8efd-0b36a4069e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:58.062338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801db12-2ee3-4179-8efd-0b36a4069e2e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:58.062747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801db12-2ee3-4179-8efd-0b36a4069e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:58.063136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801db12-2ee3-4179-8efd-0b36a4069e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:58.076320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801db12-2ee3-4179-8efd-0b36a4069e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:58.077826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801db12-2ee3-4179-8efd-0b36a4069e2e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:58.095441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3006877-f5c9-406c-9dbd-21c843d5f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:58.096337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006877-f5c9-406c-9dbd-21c843d5f95e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:58.096766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006877-f5c9-406c-9dbd-21c843d5f95e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:58.097188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006877-f5c9-406c-9dbd-21c843d5f95e None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:58.098036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3006877-f5c9-406c-9dbd-21c843d5f95e None admin] RBAC: Adding query filter params (type=network) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:58.098512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3006877-f5c9-406c-9dbd-21c843d5f95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:58.100048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3006877-f5c9-406c-9dbd-21c843d5f95e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c801db12-2ee3-4179-8efd-0b36a4069e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:58.101557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:58.102551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:58.103474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:58.103474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:58.103474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:58.103474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:58.112780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 412/825] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:58.112780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801db12-2ee3-4179-8efd-0b36a4069e2e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:58.113017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 413/825] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:54:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:58.113017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3006877-f5c9-406c-9dbd-21c843d5f95e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:58.190282 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:58.241004 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801db12-2ee3-4179-8efd-0b36a4069e2e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:58.247188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3006877-f5c9-406c-9dbd-21c843d5f95e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:58.277711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7bf2f-50a1-4074-8720-2b6db7d9cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:58.278413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7bf2f-50a1-4074-8720-2b6db7d9cddb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:58.278717 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7bf2f-50a1-4074-8720-2b6db7d9cddb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:58.279005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7bf2f-50a1-4074-8720-2b6db7d9cddb None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:58.279808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7bf2f-50a1-4074-8720-2b6db7d9cddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:58.280121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7bf2f-50a1-4074-8720-2b6db7d9cddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:58.281627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7bf2f-50a1-4074-8720-2b6db7d9cddb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:58.289004 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c9f06-4fe0-4c28-bfa9-08bd22a8544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:58.290212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:58.291654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9f06-4fe0-4c28-bfa9-08bd22a8544d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:58.292731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9f06-4fe0-4c28-bfa9-08bd22a8544d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:58.293407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9f06-4fe0-4c28-bfa9-08bd22a8544d None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:58.295029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c9f06-4fe0-4c28-bfa9-08bd22a8544d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:58.295558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c9f06-4fe0-4c28-bfa9-08bd22a8544d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:58.297385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c9f06-4fe0-4c28-bfa9-08bd22a8544d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:58.301502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 413/826] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:58.302420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7bf2f-50a1-4074-8720-2b6db7d9cddb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:58.311714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 414/827] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:58.312949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c9f06-4fe0-4c28-bfa9-08bd22a8544d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:58.428213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c9f06-4fe0-4c28-bfa9-08bd22a8544d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:58.437702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7bf2f-50a1-4074-8720-2b6db7d9cddb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:58.450468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:58.468142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538499d-365a-46a8-b579-302166adb962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:58.469101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538499d-365a-46a8-b579-302166adb962 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:58.469553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538499d-365a-46a8-b579-302166adb962 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:58.469978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538499d-365a-46a8-b579-302166adb962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:58.471216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538499d-365a-46a8-b579-302166adb962 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=9021e2249e11489083139e210562ce44) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:58.472128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538499d-365a-46a8-b579-302166adb962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:58.474265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538499d-365a-46a8-b579-302166adb962 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:58.482899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 415/828] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:54:58 2022] GET /identity/v3/role_assignments?user.id=9021e2249e11489083139e210562ce44&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=af8084c48e3c40298e26d44d6d14595a => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:58.483855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538499d-365a-46a8-b579-302166adb962 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:58.488142 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9d600-0022-4b5f-85d6-87145de09309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:58.488829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9d600-0022-4b5f-85d6-87145de09309 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:58.489437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9d600-0022-4b5f-85d6-87145de09309 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:58.490018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9d600-0022-4b5f-85d6-87145de09309 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:58.491202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9d600-0022-4b5f-85d6-87145de09309 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:58.500070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9d600-0022-4b5f-85d6-87145de09309 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:58.566349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 414/829] 10.222.0.30 () {60 vars in 1144 bytes} [Mon May 23 17:54:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:54:58.635911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538499d-365a-46a8-b579-302166adb962 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:58.713771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19c784-5fb5-4257-b633-cfe17020c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:58.714523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c784-5fb5-4257-b633-cfe17020c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:58.714832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c784-5fb5-4257-b633-cfe17020c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:58.715110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c784-5fb5-4257-b633-cfe17020c5e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:58.726637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19c784-5fb5-4257-b633-cfe17020c5e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:58.727806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2b0a-220c-44f4-bb70-6ee6d8008245 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:58.728106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2b0a-220c-44f4-bb70-6ee6d8008245 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:58.728384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2b0a-220c-44f4-bb70-6ee6d8008245 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:58.728674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19c784-5fb5-4257-b633-cfe17020c5e4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:58.729866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 415/830] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:54:58.738673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c922802-2ae2-4b9f-a4c9-7414d6e730e0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:58.738994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c922802-2ae2-4b9f-a4c9-7414d6e730e0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:58.739280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c922802-2ae2-4b9f-a4c9-7414d6e730e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-ea19c784-5fb5-4257-b633-cfe17020c5e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:54:58.745348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:58.746359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:58.747271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:54:58.747271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:54:58.747271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:54:58.747271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:54:58.747271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:54:58.747271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:54:58.747271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:54:58.747271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:58.747271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 416/831] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:58.755787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19c784-5fb5-4257-b633-cfe17020c5e4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:58.763838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5c922802-2ae2-4b9f-a4c9-7414d6e730e0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:58.765468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5c922802-2ae2-4b9f-a4c9-7414d6e730e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:58.816149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:58.832685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:58.869445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 416/832] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:54:58.894562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c922802-2ae2-4b9f-a4c9-7414d6e730e0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:58.896252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19c784-5fb5-4257-b633-cfe17020c5e4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:58.943102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5eb21-de06-4db2-ae20-eb442255b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:58.943778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5eb21-de06-4db2-ae20-eb442255b16c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:58.944062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5eb21-de06-4db2-ae20-eb442255b16c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:58.944339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5eb21-de06-4db2-ae20-eb442255b16c None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:58.945602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5eb21-de06-4db2-ae20-eb442255b16c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:58.945921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5eb21-de06-4db2-ae20-eb442255b16c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:58.948051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5eb21-de06-4db2-ae20-eb442255b16c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:58.974311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 417/833] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:54:58.976834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5eb21-de06-4db2-ae20-eb442255b16c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:59.022017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c922802-2ae2-4b9f-a4c9-7414d6e730e0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:59.058097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f605-ea94-4ec9-9b85-7a97c9f4f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:59.059301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f605-ea94-4ec9-9b85-7a97c9f4f436 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:59.059301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f605-ea94-4ec9-9b85-7a97c9f4f436 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:59.059501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f605-ea94-4ec9-9b85-7a97c9f4f436 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:59.069921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1f605-ea94-4ec9-9b85-7a97c9f4f436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-a0a1f605-ea94-4ec9-9b85-7a97c9f4f436 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:54:59.077844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:59.078836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:54:59.079706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:54:59.084000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 417/834] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:54:59.085323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f605-ea94-4ec9-9b85-7a97c9f4f436 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:59.094912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:59.100219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5eb21-de06-4db2-ae20-eb442255b16c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:59.131047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:59.141808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6e93e-3391-487e-8072-75563921b032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:59.143131 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6e93e-3391-487e-8072-75563921b032 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:59.143646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6e93e-3391-487e-8072-75563921b032 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:59.144125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6e93e-3391-487e-8072-75563921b032 None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/3170dcaf527b44b8bd33cae78b39fb2f/roles/ced991a120aa41709516ad31b1c57a89` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:59.162089 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6e93e-3391-487e-8072-75563921b032 None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=3170dcaf527b44b8bd33cae78b39fb2f, role_id=ced991a120aa41709516ad31b1c57a89)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:59.163886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6e93e-3391-487e-8072-75563921b032 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:59.186732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 418/835] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:54:58 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/3170dcaf527b44b8bd33cae78b39fb2f/roles/ced991a120aa41709516ad31b1c57a89 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:54:59.193937 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f605-ea94-4ec9-9b85-7a97c9f4f436 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:59.234730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8381b9-166d-420d-8eb9-041dbf0a748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:59.235467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8381b9-166d-420d-8eb9-041dbf0a748e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:59.235754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8381b9-166d-420d-8eb9-041dbf0a748e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:59.236031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8381b9-166d-420d-8eb9-041dbf0a748e None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:59.236794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8381b9-166d-420d-8eb9-041dbf0a748e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:59.237102 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8381b9-166d-420d-8eb9-041dbf0a748e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:59.238572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8381b9-166d-420d-8eb9-041dbf0a748e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:59.256924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 418/836] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:54:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:59.262204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6e93e-3391-487e-8072-75563921b032 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:59.392420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6e93e-3391-487e-8072-75563921b032 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:59.429791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34200fb-5fd8-4518-9c50-d6b915b3366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:59.430819 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34200fb-5fd8-4518-9c50-d6b915b3366e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:59.431348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34200fb-5fd8-4518-9c50-d6b915b3366e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:59.431348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34200fb-5fd8-4518-9c50-d6b915b3366e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:59.442164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34200fb-5fd8-4518-9c50-d6b915b3366e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:59.443694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34200fb-5fd8-4518-9c50-d6b915b3366e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-f34200fb-5fd8-4518-9c50-d6b915b3366e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:54:59.464441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:59.465391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:59.466514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:54:59.466514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:54:59.466514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:54:59.466514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:59.466514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 419/837] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:59.472652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8381b9-166d-420d-8eb9-041dbf0a748e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:59.585063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8381b9-166d-420d-8eb9-041dbf0a748e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:59.589446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:59.624512 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7265d2f-a4aa-4c16-906d-04a8eb47c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:59.625625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265d2f-a4aa-4c16-906d-04a8eb47c4fe None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:59.626085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265d2f-a4aa-4c16-906d-04a8eb47c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:59.635111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265d2f-a4aa-4c16-906d-04a8eb47c4fe None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:59.636186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7265d2f-a4aa-4c16-906d-04a8eb47c4fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:54:59.636698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7265d2f-a4aa-4c16-906d-04a8eb47c4fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:59.638294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7265d2f-a4aa-4c16-906d-04a8eb47c4fe None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:59.656657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 419/838] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:54:59.659801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34200fb-5fd8-4518-9c50-d6b915b3366e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:59.684911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:54:59.773990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34200fb-5fd8-4518-9c50-d6b915b3366e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:54:59.811335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822ea75-3a48-43c8-9260-ddfe259932b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:54:59.812427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ea75-3a48-43c8-9260-ddfe259932b5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:59.812886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ea75-3a48-43c8-9260-ddfe259932b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:59.813377 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ea75-3a48-43c8-9260-ddfe259932b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:59.821532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822ea75-3a48-43c8-9260-ddfe259932b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:54:59.823718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822ea75-3a48-43c8-9260-ddfe259932b5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-c822ea75-3a48-43c8-9260-ddfe259932b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:54:59.839884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:54:59.840863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:54:59.841798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:54:59.841798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:54:59.841798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:54:59.841798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:54:59.841798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:54:59.841798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:54:59.841798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:54:59.841798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:54:59.841798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 17:54:59.841798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:54:59.848601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 420/839] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:54:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:54:59.850114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7265d2f-a4aa-4c16-906d-04a8eb47c4fe None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:54:59.900885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6826-f419-48b4-a74e-9bb7c56e389e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:59.901428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6826-f419-48b4-a74e-9bb7c56e389e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:59.902149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6826-f419-48b4-a74e-9bb7c56e389e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:59.904144 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 421/840] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:54:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:54:59.909491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb148fa-5562-4fdf-81b5-07b78d68bf2a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:54:59.909818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb148fa-5562-4fdf-81b5-07b78d68bf2a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:54:59.910055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb148fa-5562-4fdf-81b5-07b78d68bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:54:59.931558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ddb148fa-5562-4fdf-81b5-07b78d68bf2a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:54:59.932918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ddb148fa-5562-4fdf-81b5-07b78d68bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:54:59.971941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7265d2f-a4aa-4c16-906d-04a8eb47c4fe None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:00.009700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:00.019597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541817a-cf15-45b9-9180-d9750224c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:00.020752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541817a-cf15-45b9-9180-d9750224c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:00.021215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541817a-cf15-45b9-9180-d9750224c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:00.021681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541817a-cf15-45b9-9180-d9750224c5c4 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:00.022687 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541817a-cf15-45b9-9180-d9750224c5c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:00.023249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541817a-cf15-45b9-9180-d9750224c5c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:00.027029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541817a-cf15-45b9-9180-d9750224c5c4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:00.029216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 422/841] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:54:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:00.048039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb148fa-5562-4fdf-81b5-07b78d68bf2a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:00.053924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 420/842] 10.222.0.30 () {56 vars in 1135 bytes} [Mon May 23 17:54:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:00.061593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541817a-cf15-45b9-9180-d9750224c5c4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:00.095751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:00.182608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb148fa-5562-4fdf-81b5-07b78d68bf2a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:00.199773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541817a-cf15-45b9-9180-d9750224c5c4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:00.219305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44f5c0-a8b4-4c98-a701-5e011000a9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:00.220217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44f5c0-a8b4-4c98-a701-5e011000a9ef None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:00.220594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44f5c0-a8b4-4c98-a701-5e011000a9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:00.220983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44f5c0-a8b4-4c98-a701-5e011000a9ef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:00.221723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44f5c0-a8b4-4c98-a701-5e011000a9ef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:00.223216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44f5c0-a8b4-4c98-a701-5e011000a9ef None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-6e44f5c0-a8b4-4c98-a701-5e011000a9ef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:00.236247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:00.237516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:55:00.238608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:00.241191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8083d-ca7d-4513-a011-267fac6b1980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:00.242090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8083d-ca7d-4513-a011-267fac6b1980 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:00.242579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8083d-ca7d-4513-a011-267fac6b1980 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:00.243872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8083d-ca7d-4513-a011-267fac6b1980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:00.246032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 423/843] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:55:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:00.247318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44f5c0-a8b4-4c98-a701-5e011000a9ef None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:00.309972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:00.318528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8083d-ca7d-4513-a011-267fac6b1980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:00.320332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8083d-ca7d-4513-a011-267fac6b1980 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:00.344817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:00.359403 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44f5c0-a8b4-4c98-a701-5e011000a9ef None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:00.397740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd25f1-bb3b-4f36-ae22-d39d042ba70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:00.398414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd25f1-bb3b-4f36-ae22-d39d042ba70a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:00.398711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd25f1-bb3b-4f36-ae22-d39d042ba70a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:00.399040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd25f1-bb3b-4f36-ae22-d39d042ba70a None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:00.400441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd25f1-bb3b-4f36-ae22-d39d042ba70a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:00.400726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd25f1-bb3b-4f36-ae22-d39d042ba70a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:00.402150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd25f1-bb3b-4f36-ae22-d39d042ba70a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:00.411724 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 424/844] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:55:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:00.412897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd25f1-bb3b-4f36-ae22-d39d042ba70a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:00.439849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 421/845] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 17:55:00.441185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8083d-ca7d-4513-a011-267fac6b1980 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:00.523078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd25f1-bb3b-4f36-ae22-d39d042ba70a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:00.545172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:00.561493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8083d-ca7d-4513-a011-267fac6b1980 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:00.563830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d44b36-058f-4157-8d79-6ea32b9f6a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:00.564492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d44b36-058f-4157-8d79-6ea32b9f6a9a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:00.564771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d44b36-058f-4157-8d79-6ea32b9f6a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:00.565040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d44b36-058f-4157-8d79-6ea32b9f6a9a None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:00.566098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d44b36-058f-4157-8d79-6ea32b9f6a9a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:00.566098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d44b36-058f-4157-8d79-6ea32b9f6a9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:00.567392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d44b36-058f-4157-8d79-6ea32b9f6a9a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:00.578844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 425/846] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:55:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:00.591587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:00.611884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f0166-038a-480a-bac0-44688fd2b7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:00.613116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0166-038a-480a-bac0-44688fd2b7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:00.613616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0166-038a-480a-bac0-44688fd2b7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:00.614112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0166-038a-480a-bac0-44688fd2b7b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:00.627163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f0166-038a-480a-bac0-44688fd2b7b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:00.629180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f0166-038a-480a-bac0-44688fd2b7b1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-962f0166-038a-480a-bac0-44688fd2b7b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:00.650669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:00.651688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:00.652583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:00.652583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:00.652583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:00.652583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:00.655025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 422/847] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:00.661002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d44b36-058f-4157-8d79-6ea32b9f6a9a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:00.781423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d44b36-058f-4157-8d79-6ea32b9f6a9a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:00.824713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2b3aa-8fa9-40d0-b71b-5db44709036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:00.825300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2b3aa-8fa9-40d0-b71b-5db44709036c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:00.825578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2b3aa-8fa9-40d0-b71b-5db44709036c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:00.825850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2b3aa-8fa9-40d0-b71b-5db44709036c None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:00.826570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2b3aa-8fa9-40d0-b71b-5db44709036c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:00.826913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2b3aa-8fa9-40d0-b71b-5db44709036c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:00.828270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2b3aa-8fa9-40d0-b71b-5db44709036c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:00.841500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 426/848] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:00.847153 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f0166-038a-480a-bac0-44688fd2b7b1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:00.956842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f0166-038a-480a-bac0-44688fd2b7b1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:00.971781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c391-058f-4fa0-9200-61048d6f40eb None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:00.972125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c391-058f-4fa0-9200-61048d6f40eb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:00.972337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c391-058f-4fa0-9200-61048d6f40eb None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:00.973979 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 427/849] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:00.980776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f685c-5c41-4478-a251-2c9328bc34c0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:00.980776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f685c-5c41-4478-a251-2c9328bc34c0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:00.981029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f685c-5c41-4478-a251-2c9328bc34c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:00.998189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e906fbe-7fd6-47c1-b27c-e8b75eab3198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:00.998527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ff8f685c-5c41-4478-a251-2c9328bc34c0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:00.999580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e906fbe-7fd6-47c1-b27c-e8b75eab3198 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:00.999691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ff8f685c-5c41-4478-a251-2c9328bc34c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:01.000183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e906fbe-7fd6-47c1-b27c-e8b75eab3198 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:01.000668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e906fbe-7fd6-47c1-b27c-e8b75eab3198 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:01.011501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e906fbe-7fd6-47c1-b27c-e8b75eab3198 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:01.013982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e906fbe-7fd6-47c1-b27c-e8b75eab3198 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-4e906fbe-7fd6-47c1-b27c-e8b75eab3198 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:55:01.032005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:01.032957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:01.033885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:55:01.033885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:55:01.033885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:55:01.033885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:55:01.033885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:55:01.033885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:55:01.033885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:01.033885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:01.037885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 423/850] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:01.039074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e906fbe-7fd6-47c1-b27c-e8b75eab3198 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:01.056277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:01.078047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:01.097908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 428/851] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:01.119798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f685c-5c41-4478-a251-2c9328bc34c0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:01.193314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e906fbe-7fd6-47c1-b27c-e8b75eab3198 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:01.237001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b42ae-485e-4b3c-860e-5f05dd81b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:01.237688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b42ae-485e-4b3c-860e-5f05dd81b1ae None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:01.237976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b42ae-485e-4b3c-860e-5f05dd81b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:01.238251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b42ae-485e-4b3c-860e-5f05dd81b1ae None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:01.239102 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b42ae-485e-4b3c-860e-5f05dd81b1ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:01.239416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b42ae-485e-4b3c-860e-5f05dd81b1ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:01.240965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b42ae-485e-4b3c-860e-5f05dd81b1ae None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:01.264659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 424/852] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:55:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:01.268323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b42ae-485e-4b3c-860e-5f05dd81b1ae None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:01.297717 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f685c-5c41-4478-a251-2c9328bc34c0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:01.339217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b5cd-34c5-44c2-b98c-d8816632db23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:01.340589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b5cd-34c5-44c2-b98c-d8816632db23 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:01.342797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b5cd-34c5-44c2-b98c-d8816632db23 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:01.344112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b5cd-34c5-44c2-b98c-d8816632db23 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:01.345277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b5cd-34c5-44c2-b98c-d8816632db23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:01.347906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b5cd-34c5-44c2-b98c-d8816632db23 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-2619b5cd-34c5-44c2-b98c-d8816632db23 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:01.377746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:01.378790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:55:01.379660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:01.390924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 429/853] 10.222.0.30 () {56 vars in 1132 bytes} [Mon May 23 17:55:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:01.392998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b5cd-34c5-44c2-b98c-d8816632db23 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:01.462664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:01.479639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:01.481539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b42ae-485e-4b3c-860e-5f05dd81b1ae None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:01.535899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d304a-ec54-4b88-99d9-8061b9c9ca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:01.536770 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d304a-ec54-4b88-99d9-8061b9c9ca91 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:01.537199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d304a-ec54-4b88-99d9-8061b9c9ca91 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:01.537631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d304a-ec54-4b88-99d9-8061b9c9ca91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:01.538611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d304a-ec54-4b88-99d9-8061b9c9ca91 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=fcbd7035e027494cb063489b375cb385) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:01.539108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d304a-ec54-4b88-99d9-8061b9c9ca91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:01.540855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d304a-ec54-4b88-99d9-8061b9c9ca91 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:01.547375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 425/854] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:01 2022] GET /identity/v3/role_assignments?user.id=fcbd7035e027494cb063489b375cb385&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=af8084c48e3c40298e26d44d6d14595a => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:01.548801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ddee-b9f9-436e-8abb-c0b0770bf8bc None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:01.549235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ddee-b9f9-436e-8abb-c0b0770bf8bc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:01.549673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871ddee-b9f9-436e-8abb-c0b0770bf8bc None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:01.551598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 426/855] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:01.565855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b5cd-34c5-44c2-b98c-d8816632db23 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:01.572527 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e9f9a-7569-4a2a-9c93-73ae6269d062 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:01.573076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e9f9a-7569-4a2a-9c93-73ae6269d062 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:01.573511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e9f9a-7569-4a2a-9c93-73ae6269d062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:01.596730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f19e9f9a-7569-4a2a-9c93-73ae6269d062 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:01.599579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f19e9f9a-7569-4a2a-9c93-73ae6269d062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:01.613638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbaeed-3805-4c7f-b448-36234b3018a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:01.615278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbaeed-3805-4c7f-b448-36234b3018a4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:01.615841 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbaeed-3805-4c7f-b448-36234b3018a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:01.616277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbaeed-3805-4c7f-b448-36234b3018a4 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:01.617447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbaeed-3805-4c7f-b448-36234b3018a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:01.617976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbaeed-3805-4c7f-b448-36234b3018a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:01.620966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbaeed-3805-4c7f-b448-36234b3018a4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:01.628644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 430/856] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:01.636345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbaeed-3805-4c7f-b448-36234b3018a4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:01.700260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 427/857] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:01.723940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e9f9a-7569-4a2a-9c93-73ae6269d062 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:01.782784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbaeed-3805-4c7f-b448-36234b3018a4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:01.788093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:01.831347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e5857-e996-45d1-854f-903bcccf2147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:01.832051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e5857-e996-45d1-854f-903bcccf2147 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:01.832332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e5857-e996-45d1-854f-903bcccf2147 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:01.832605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e5857-e996-45d1-854f-903bcccf2147 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:01.833308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e5857-e996-45d1-854f-903bcccf2147 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:01.833614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e5857-e996-45d1-854f-903bcccf2147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:01.835548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e5857-e996-45d1-854f-903bcccf2147 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:01.837186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:01.844251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 431/858] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:01.862631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e9f9a-7569-4a2a-9c93-73ae6269d062 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:01.903849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063af2-e456-44e6-b057-ce117dbe87f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:01.904686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063af2-e456-44e6-b057-ce117dbe87f0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:01.904967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063af2-e456-44e6-b057-ce117dbe87f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:01.905240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063af2-e456-44e6-b057-ce117dbe87f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:01.917808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69063af2-e456-44e6-b057-ce117dbe87f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-69063af2-e456-44e6-b057-ce117dbe87f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:01.926037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:01.927104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:01.927947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 428/859] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:55:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:01.933866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e5857-e996-45d1-854f-903bcccf2147 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:02.052727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e5857-e996-45d1-854f-903bcccf2147 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:02.098832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6038c7-a181-41ce-85f9-7c3b8e39cec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:02.099505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6038c7-a181-41ce-85f9-7c3b8e39cec4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:02.099787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6038c7-a181-41ce-85f9-7c3b8e39cec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:02.100065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6038c7-a181-41ce-85f9-7c3b8e39cec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:02.100813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6038c7-a181-41ce-85f9-7c3b8e39cec4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:02.101194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6038c7-a181-41ce-85f9-7c3b8e39cec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:02.102605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6038c7-a181-41ce-85f9-7c3b8e39cec4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:02.111701 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 432/860] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:55:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:02.119819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063af2-e456-44e6-b057-ce117dbe87f0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:02.230567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063af2-e456-44e6-b057-ce117dbe87f0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:02.269594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc175f2-eb57-4c82-a658-15f4bb6a6d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:02.270395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc175f2-eb57-4c82-a658-15f4bb6a6d45 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:02.270680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc175f2-eb57-4c82-a658-15f4bb6a6d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:02.270986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc175f2-eb57-4c82-a658-15f4bb6a6d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:02.282092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc175f2-eb57-4c82-a658-15f4bb6a6d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:02.283574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc175f2-eb57-4c82-a658-15f4bb6a6d45 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:02.292576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ecc175f2-eb57-4c82-a658-15f4bb6a6d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:02.303085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:02.304933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:02.306806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:02.306806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:02.306806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:02.306806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:02.306806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 429/861] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:02.310425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6038c7-a181-41ce-85f9-7c3b8e39cec4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:02.341273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:02.421002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6038c7-a181-41ce-85f9-7c3b8e39cec4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:02.457160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b26665-8277-428a-97ab-385cd82addbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:02.457825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26665-8277-428a-97ab-385cd82addbe None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:02.458114 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26665-8277-428a-97ab-385cd82addbe None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:02.458388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26665-8277-428a-97ab-385cd82addbe None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:02.459143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b26665-8277-428a-97ab-385cd82addbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:02.459450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b26665-8277-428a-97ab-385cd82addbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:02.460811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b26665-8277-428a-97ab-385cd82addbe None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:02.473714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 433/862] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:02.479700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc175f2-eb57-4c82-a658-15f4bb6a6d45 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:02.583731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc175f2-eb57-4c82-a658-15f4bb6a6d45 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:02.618788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0609e-2dc5-4696-b4ec-860d401e4f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:02.619619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0609e-2dc5-4696-b4ec-860d401e4f26 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:02.619948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0609e-2dc5-4696-b4ec-860d401e4f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:02.620230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0609e-2dc5-4696-b4ec-860d401e4f26 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:02.628109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0609e-2dc5-4696-b4ec-860d401e4f26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:02.629567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0609e-2dc5-4696-b4ec-860d401e4f26 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-fad0609e-2dc5-4696-b4ec-860d401e4f26 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:55:02.645343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:02.647198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:02.649765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 430/863] 10.222.0.30 () {56 vars in 1117 bytes} [Mon May 23 17:55:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:02.653276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b26665-8277-428a-97ab-385cd82addbe None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:02.763392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:02.775511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b26665-8277-428a-97ab-385cd82addbe None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:02.813615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a590098-367f-4595-af89-b41b6730af1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:02.814438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590098-367f-4595-af89-b41b6730af1c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:02.814617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590098-367f-4595-af89-b41b6730af1c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:02.814883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590098-367f-4595-af89-b41b6730af1c None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:02.815768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a590098-367f-4595-af89-b41b6730af1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:02.816081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a590098-367f-4595-af89-b41b6730af1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:02.817605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a590098-367f-4595-af89-b41b6730af1c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:02.838565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 434/864] 10.222.0.30 () {56 vars in 1149 bytes} [Mon May 23 17:55:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:02.844253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0609e-2dc5-4696-b4ec-860d401e4f26 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:02.907197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:02.950261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0609e-2dc5-4696-b4ec-860d401e4f26 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:02.984122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69031e-03e8-4fd0-85ec-4e2229556af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:02.984775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69031e-03e8-4fd0-85ec-4e2229556af1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:02.985061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69031e-03e8-4fd0-85ec-4e2229556af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:02.985338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69031e-03e8-4fd0-85ec-4e2229556af1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:03.014257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f8a40-ef6a-490b-8283-62a5d69840cf None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:03.014610 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f8a40-ef6a-490b-8283-62a5d69840cf None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:03.015123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f8a40-ef6a-490b-8283-62a5d69840cf None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:03.017560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 435/865] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:03.022604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acff6d8-0fdb-4b90-b6c0-e622df2866f7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:03.022981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acff6d8-0fdb-4b90-b6c0-e622df2866f7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:03.023256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acff6d8-0fdb-4b90-b6c0-e622df2866f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:03.041241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6acff6d8-0fdb-4b90-b6c0-e622df2866f7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:03.042972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6acff6d8-0fdb-4b90-b6c0-e622df2866f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:03.078948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69031e-03e8-4fd0-85ec-4e2229556af1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:03.081244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69031e-03e8-4fd0-85ec-4e2229556af1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:03.128915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 436/866] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:03.149540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acff6d8-0fdb-4b90-b6c0-e622df2866f7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:03.150380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:03.193980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 431/867] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:55:03.200205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69031e-03e8-4fd0-85ec-4e2229556af1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:03.239882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:03.266434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acff6d8-0fdb-4b90-b6c0-e622df2866f7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:03.303561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69031e-03e8-4fd0-85ec-4e2229556af1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:03.305257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7510360-255c-4fd5-9db8-bcd2d033ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:03.306278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7510360-255c-4fd5-9db8-bcd2d033ba9a None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:03.306817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7510360-255c-4fd5-9db8-bcd2d033ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:03.307443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7510360-255c-4fd5-9db8-bcd2d033ba9a None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:03.308383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7510360-255c-4fd5-9db8-bcd2d033ba9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:03.309956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7510360-255c-4fd5-9db8-bcd2d033ba9a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:03.335079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 437/868] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:55:03 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:55:03.346880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1ba90-533f-4671-a29f-073c94f59f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:03.347745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1ba90-533f-4671-a29f-073c94f59f95 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:03.348030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1ba90-533f-4671-a29f-073c94f59f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:03.348301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1ba90-533f-4671-a29f-073c94f59f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:03.361272 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1ba90-533f-4671-a29f-073c94f59f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:03.362788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1ba90-533f-4671-a29f-073c94f59f95 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3cb1ba90-533f-4671-a29f-073c94f59f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:03.388868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:03.389850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:03.391320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:03.391320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:03.391320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:03.391320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:03.395190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 432/869] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:03.396794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7510360-255c-4fd5-9db8-bcd2d033ba9a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:03.513690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7510360-255c-4fd5-9db8-bcd2d033ba9a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:03.550665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26885-3edc-4540-9470-cce9985393e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:03.551364 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26885-3edc-4540-9470-cce9985393e6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:03.551648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26885-3edc-4540-9470-cce9985393e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:03.551922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26885-3edc-4540-9470-cce9985393e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:03.552647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa26885-3edc-4540-9470-cce9985393e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:03.552958 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa26885-3edc-4540-9470-cce9985393e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:03.554391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa26885-3edc-4540-9470-cce9985393e6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:03.562385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:03.567961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 438/870] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:03.573828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1ba90-533f-4671-a29f-073c94f59f95 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:03.585279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:03.680509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1ba90-533f-4671-a29f-073c94f59f95 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:03.715977 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce5764-7893-47af-aa22-619426477ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:03.716788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce5764-7893-47af-aa22-619426477ccb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:03.717071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce5764-7893-47af-aa22-619426477ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:03.717347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce5764-7893-47af-aa22-619426477ccb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:03.724572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce5764-7893-47af-aa22-619426477ccb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:03.726021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce5764-7893-47af-aa22-619426477ccb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-04ce5764-7893-47af-aa22-619426477ccb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:55:03.740795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:03.741756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:03.742802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:55:03.742802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:55:03.742802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:55:03.742802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:55:03.742802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:55:03.742802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:55:03.742802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:03.742802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:03.742802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 433/871] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:03.748341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26885-3edc-4540-9470-cce9985393e6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:03.857522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26885-3edc-4540-9470-cce9985393e6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:03.893846 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bc20b-0155-4c5e-9d8d-56c74aa337dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:03.894516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bc20b-0155-4c5e-9d8d-56c74aa337dd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:03.894826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bc20b-0155-4c5e-9d8d-56c74aa337dd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:03.895105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bc20b-0155-4c5e-9d8d-56c74aa337dd None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:03.895892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bc20b-0155-4c5e-9d8d-56c74aa337dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:03.896204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bc20b-0155-4c5e-9d8d-56c74aa337dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:03.897635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bc20b-0155-4c5e-9d8d-56c74aa337dd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:03.910320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 439/872] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:55:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:03.916192 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce5764-7893-47af-aa22-619426477ccb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:03.950510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41aa0d-ddb4-434c-9a49-0737c12df28e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:03.950848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41aa0d-ddb4-434c-9a49-0737c12df28e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:03.951131 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41aa0d-ddb4-434c-9a49-0737c12df28e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:03.953346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 440/873] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:03.959823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727bebe-c3f1-4ba3-b524-e0eab831f8c9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:03.960223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727bebe-c3f1-4ba3-b524-e0eab831f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:03.960608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727bebe-c3f1-4ba3-b524-e0eab831f8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:03.978095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7727bebe-c3f1-4ba3-b524-e0eab831f8c9 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:03.979467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7727bebe-c3f1-4ba3-b524-e0eab831f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:03.991101 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:04.027393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce5764-7893-47af-aa22-619426477ccb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:04.039054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:04.054856 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 441/874] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:04.070849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39c5e6-dbc7-4bd3-8664-e1b338ae371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:04.071574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39c5e6-dbc7-4bd3-8664-e1b338ae371a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:04.071856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39c5e6-dbc7-4bd3-8664-e1b338ae371a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:04.072131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39c5e6-dbc7-4bd3-8664-e1b338ae371a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:04.072982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39c5e6-dbc7-4bd3-8664-e1b338ae371a None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=3170dcaf527b44b8bd33cae78b39fb2f) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:04.073292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39c5e6-dbc7-4bd3-8664-e1b338ae371a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:04.074774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39c5e6-dbc7-4bd3-8664-e1b338ae371a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:04.077457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727bebe-c3f1-4ba3-b524-e0eab831f8c9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:04.085604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 434/875] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:03 2022] GET /identity/v3/role_assignments?user.id=3170dcaf527b44b8bd33cae78b39fb2f&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:04.204848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727bebe-c3f1-4ba3-b524-e0eab831f8c9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:04.246554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1cd3d-0b06-4043-904f-532aad9f36d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:04.247405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1cd3d-0b06-4043-904f-532aad9f36d8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:04.247683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1cd3d-0b06-4043-904f-532aad9f36d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:04.247956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1cd3d-0b06-4043-904f-532aad9f36d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:04.248619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1cd3d-0b06-4043-904f-532aad9f36d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:04.250083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1cd3d-0b06-4043-904f-532aad9f36d8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-37a1cd3d-0b06-4043-904f-532aad9f36d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:04.264074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:04.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:04.265985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 442/876] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:04.273673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39c5e6-dbc7-4bd3-8664-e1b338ae371a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:04.295809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84df5-f43e-4d23-add5-d60487670b03 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:04.296115 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84df5-f43e-4d23-add5-d60487670b03 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:04.296360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84df5-f43e-4d23-add5-d60487670b03 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:04.298019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 443/877] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:55:04.303398 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a967-06c2-4b7a-9738-0fce6f56f436 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:04.303680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a967-06c2-4b7a-9738-0fce6f56f436 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:04.304385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a967-06c2-4b7a-9738-0fce6f56f436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:04.326639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d514a967-06c2-4b7a-9738-0fce6f56f436 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:04.327847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d514a967-06c2-4b7a-9738-0fce6f56f436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:04.382839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:04.403295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39c5e6-dbc7-4bd3-8664-e1b338ae371a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:04.410622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 444/878] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:04.437581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a967-06c2-4b7a-9738-0fce6f56f436 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:04.451013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95c35f-953f-402d-929d-b07bcf7568f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:04.452269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95c35f-953f-402d-929d-b07bcf7568f0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:04.453257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95c35f-953f-402d-929d-b07bcf7568f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:04.453867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95c35f-953f-402d-929d-b07bcf7568f0 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:04.454960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95c35f-953f-402d-929d-b07bcf7568f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:04.455712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95c35f-953f-402d-929d-b07bcf7568f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:04.457665 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95c35f-953f-402d-929d-b07bcf7568f0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:04.459188 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:04.465753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 435/879] 10.222.0.30 () {56 vars in 1122 bytes} [Mon May 23 17:55:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:04.472123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95c35f-953f-402d-929d-b07bcf7568f0 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:04.552842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a967-06c2-4b7a-9738-0fce6f56f436 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:04.596962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1baab1-f519-4323-96de-2295f345fd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:04.598036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1baab1-f519-4323-96de-2295f345fd14 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:04.598537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1baab1-f519-4323-96de-2295f345fd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:04.599002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1baab1-f519-4323-96de-2295f345fd14 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:04.599882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1baab1-f519-4323-96de-2295f345fd14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:04.601610 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1baab1-f519-4323-96de-2295f345fd14 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:04.609025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95c35f-953f-402d-929d-b07bcf7568f0 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:04.621027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 445/880] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:55:04 2022] POST /identity/v3/services => generated 269 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:55:04.653720 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a0487-caab-489c-8467-3888c74785e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:04.654403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0487-caab-489c-8467-3888c74785e2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:04.654686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0487-caab-489c-8467-3888c74785e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:04.654989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0487-caab-489c-8467-3888c74785e2 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:04.655706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a0487-caab-489c-8467-3888c74785e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:04.656012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a0487-caab-489c-8467-3888c74785e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:04.657414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a0487-caab-489c-8467-3888c74785e2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:04.663179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 436/881] 10.222.0.30 () {56 vars in 1122 bytes} [Mon May 23 17:55:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:05.710541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b7fe-a14a-4fbb-9d4e-3a0d9d3e88dc None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:05.711085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b7fe-a14a-4fbb-9d4e-3a0d9d3e88dc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:05.711592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b7fe-a14a-4fbb-9d4e-3a0d9d3e88dc None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:05.713314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 446/882] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:05.718495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e5f6-814d-4b0d-a990-8708801749f4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:05.718905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e5f6-814d-4b0d-a990-8708801749f4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:05.719253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e5f6-814d-4b0d-a990-8708801749f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:05.736796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a0f4e5f6-814d-4b0d-a990-8708801749f4 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:05.737968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a0f4e5f6-814d-4b0d-a990-8708801749f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:05.790901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:05.811369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 437/883] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:05.834635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841b7fe-a14a-4fbb-9d4e-3a0d9d3e88dc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:05.886818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:05.949590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841b7fe-a14a-4fbb-9d4e-3a0d9d3e88dc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:05.984388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50424077-3cc7-4e37-a5e3-07f140e84095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:05.985195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50424077-3cc7-4e37-a5e3-07f140e84095 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:05.985479 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50424077-3cc7-4e37-a5e3-07f140e84095 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:05.985752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50424077-3cc7-4e37-a5e3-07f140e84095 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:05.986401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50424077-3cc7-4e37-a5e3-07f140e84095 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:05.987796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50424077-3cc7-4e37-a5e3-07f140e84095 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-50424077-3cc7-4e37-a5e3-07f140e84095 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:06.000503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:06.001483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:06.002502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 447/884] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:55:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:06.007604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e5f6-814d-4b0d-a990-8708801749f4 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:06.109579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e5f6-814d-4b0d-a990-8708801749f4 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:06.146381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58ccf3-b269-4ea0-8623-0990c105c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:06.147080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ccf3-b269-4ea0-8623-0990c105c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:06.147360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ccf3-b269-4ea0-8623-0990c105c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:06.147630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ccf3-b269-4ea0-8623-0990c105c8d1 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:06.148334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58ccf3-b269-4ea0-8623-0990c105c8d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:06.148687 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58ccf3-b269-4ea0-8623-0990c105c8d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:06.150175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58ccf3-b269-4ea0-8623-0990c105c8d1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:06.155572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 438/885] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:55:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:06.161053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50424077-3cc7-4e37-a5e3-07f140e84095 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:06.263636 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50424077-3cc7-4e37-a5e3-07f140e84095 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:06.265957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:06.298621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92bbc8-df2d-4bda-a969-12ef53cc915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:06.299360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92bbc8-df2d-4bda-a969-12ef53cc915e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:06.299644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92bbc8-df2d-4bda-a969-12ef53cc915e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:06.299955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92bbc8-df2d-4bda-a969-12ef53cc915e None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:06.300668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92bbc8-df2d-4bda-a969-12ef53cc915e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:06.300972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92bbc8-df2d-4bda-a969-12ef53cc915e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:06.302381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92bbc8-df2d-4bda-a969-12ef53cc915e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:06.307883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 448/886] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:55:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:06.313560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58ccf3-b269-4ea0-8623-0990c105c8d1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:06.365713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:06.421082 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58ccf3-b269-4ea0-8623-0990c105c8d1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:06.458904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f599e71-c349-44e2-b134-f91dbb15fbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:06.459563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f599e71-c349-44e2-b134-f91dbb15fbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:06.459843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f599e71-c349-44e2-b134-f91dbb15fbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:06.460116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f599e71-c349-44e2-b134-f91dbb15fbb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:06.460903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f599e71-c349-44e2-b134-f91dbb15fbb4 None admin] RBAC: Adding query filter params (interface=public, service_id=ac4d951f8b444fc186e6ab67e27b950d, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:06.461239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f599e71-c349-44e2-b134-f91dbb15fbb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:06.462804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f599e71-c349-44e2-b134-f91dbb15fbb4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:06.468555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 439/887] 10.222.0.30 () {56 vars in 1251 bytes} [Mon May 23 17:55:06 2022] GET /identity/v3/endpoints?service_id=ac4d951f8b444fc186e6ab67e27b950d&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:06.473914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92bbc8-df2d-4bda-a969-12ef53cc915e None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:06.587538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92bbc8-df2d-4bda-a969-12ef53cc915e None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:06.622119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641b172-382e-4438-96d7-15cbae8d804e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:06.622301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641b172-382e-4438-96d7-15cbae8d804e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:06.622584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641b172-382e-4438-96d7-15cbae8d804e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:06.624232 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 440/888] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:06.624350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b136e13-05ee-4012-b92d-03b36333a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:06.624950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b136e13-05ee-4012-b92d-03b36333a55c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:06.625242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b136e13-05ee-4012-b92d-03b36333a55c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:06.625522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b136e13-05ee-4012-b92d-03b36333a55c None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:06.626207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b136e13-05ee-4012-b92d-03b36333a55c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:06.627611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b136e13-05ee-4012-b92d-03b36333a55c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:06.631892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d331cd7-23e9-4f88-b626-1761827c0201 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:06.632301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d331cd7-23e9-4f88-b626-1761827c0201 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:06.632673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d331cd7-23e9-4f88-b626-1761827c0201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:06.634665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 449/889] 10.222.0.30 () {56 vars in 1087 bytes} [Mon May 23 17:55:06 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:55:06.656279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6d331cd7-23e9-4f88-b626-1761827c0201 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:06.657520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6d331cd7-23e9-4f88-b626-1761827c0201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:06.737755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 441/890] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:06.762064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b136e13-05ee-4012-b92d-03b36333a55c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:06.801084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:06.882939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b136e13-05ee-4012-b92d-03b36333a55c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:06.919255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96278d9b-6c3b-46ae-b5c0-3677ab755aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:06.920066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96278d9b-6c3b-46ae-b5c0-3677ab755aae None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:06.920346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96278d9b-6c3b-46ae-b5c0-3677ab755aae None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:06.920615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96278d9b-6c3b-46ae-b5c0-3677ab755aae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:06.931483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96278d9b-6c3b-46ae-b5c0-3677ab755aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-96278d9b-6c3b-46ae-b5c0-3677ab755aae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:06.939649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:06.940835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:06.941967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 450/891] 10.222.0.30 () {56 vars in 1120 bytes} [Mon May 23 17:55:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:06.947429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d331cd7-23e9-4f88-b626-1761827c0201 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:06.976244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8281-f2a8-4ff4-936e-39f9dececbf4 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:06.976678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8281-f2a8-4ff4-936e-39f9dececbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:06.977754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b8281-f2a8-4ff4-936e-39f9dececbf4 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:06.979671 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 451/892] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:06.984944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61389-14ba-4a65-9d9b-192c018e1244 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:06.985338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61389-14ba-4a65-9d9b-192c018e1244 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:06.985722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61389-14ba-4a65-9d9b-192c018e1244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:06.999075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:07.004392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7de61389-14ba-4a65-9d9b-192c018e1244 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:07.005749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7de61389-14ba-4a65-9d9b-192c018e1244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:07.051616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d331cd7-23e9-4f88-b626-1761827c0201 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:07.075944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 452/893] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:07.077269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e72241-759e-4827-b586-5264be8b35f0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.077645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e72241-759e-4827-b586-5264be8b35f0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.077931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e72241-759e-4827-b586-5264be8b35f0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.086413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 453/894] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:07.086413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1fd6-14d8-4095-bc0d-498f2743d3bb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.086413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1fd6-14d8-4095-bc0d-498f2743d3bb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.086413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1fd6-14d8-4095-bc0d-498f2743d3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.091001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83d10-596d-41ed-bb38-6e62654d4b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:07.091675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83d10-596d-41ed-bb38-6e62654d4b93 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.092017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83d10-596d-41ed-bb38-6e62654d4b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.092309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83d10-596d-41ed-bb38-6e62654d4b93 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.093037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d83d10-596d-41ed-bb38-6e62654d4b93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:07.093340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d83d10-596d-41ed-bb38-6e62654d4b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:07.094724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d83d10-596d-41ed-bb38-6e62654d4b93 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:07.103997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 442/895] 10.222.0.30 () {56 vars in 1115 bytes} [Mon May 23 17:55:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:07.104217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-de1b1fd6-14d8-4095-bc0d-498f2743d3bb None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:07.105462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-de1b1fd6-14d8-4095-bc0d-498f2743d3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:07.105846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83d10-596d-41ed-bb38-6e62654d4b93 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:07.126538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:07.190623 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 454/896] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:07.191510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b1fd6-14d8-4095-bc0d-498f2743d3bb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:07.229949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83d10-596d-41ed-bb38-6e62654d4b93 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:07.237588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:07.272350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4a757-1dd3-4c40-aa17-65111a8aa741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:07.273062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4a757-1dd3-4c40-aa17-65111a8aa741 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.273346 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4a757-1dd3-4c40-aa17-65111a8aa741 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.273708 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4a757-1dd3-4c40-aa17-65111a8aa741 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.274644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4a757-1dd3-4c40-aa17-65111a8aa741 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:07.276030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4a757-1dd3-4c40-aa17-65111a8aa741 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:07.293274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 443/897] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:55:07 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:55:07.294473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4a757-1dd3-4c40-aa17-65111a8aa741 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:07.303425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b1fd6-14d8-4095-bc0d-498f2743d3bb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:07.353644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141b6f-838e-439e-abf4-5f69e57827ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:07.354578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141b6f-838e-439e-abf4-5f69e57827ba None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.354925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141b6f-838e-439e-abf4-5f69e57827ba None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.355205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141b6f-838e-439e-abf4-5f69e57827ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.367702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95141b6f-838e-439e-abf4-5f69e57827ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:07.369195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95141b6f-838e-439e-abf4-5f69e57827ba None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:07.379809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-95141b6f-838e-439e-abf4-5f69e57827ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:07.391197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:07.392192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:07.393601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:07.393601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:07.393601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:07.393601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:07.393601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 455/898] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:07.400671 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141b6f-838e-439e-abf4-5f69e57827ba None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:07.449111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4a757-1dd3-4c40-aa17-65111a8aa741 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:07.502413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7b462-ef90-42b8-8b20-26ea6cb47eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:07.504495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7b462-ef90-42b8-8b20-26ea6cb47eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.505519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7b462-ef90-42b8-8b20-26ea6cb47eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.505998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7b462-ef90-42b8-8b20-26ea6cb47eb8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.506873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7b462-ef90-42b8-8b20-26ea6cb47eb8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:07.514070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7b462-ef90-42b8-8b20-26ea6cb47eb8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:07.530784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141b6f-838e-439e-abf4-5f69e57827ba None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-a4d7b462-ef90-42b8-8b20-26ea6cb47eb8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:07.534421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:07.535413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:55:07.536284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:07.537087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 444/899] 10.222.0.30 () {56 vars in 1132 bytes} [Mon May 23 17:55:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:07.543374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7b462-ef90-42b8-8b20-26ea6cb47eb8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:07.577489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc0a5-8f16-4560-ba9f-b936e81ca1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:07.578235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc0a5-8f16-4560-ba9f-b936e81ca1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.578583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc0a5-8f16-4560-ba9f-b936e81ca1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.578963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc0a5-8f16-4560-ba9f-b936e81ca1b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.579380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:07.579752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc0a5-8f16-4560-ba9f-b936e81ca1b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:07.580118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc0a5-8f16-4560-ba9f-b936e81ca1b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:07.581412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc0a5-8f16-4560-ba9f-b936e81ca1b2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:07.602834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 456/900] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:07.604883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc0a5-8f16-4560-ba9f-b936e81ca1b2 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:07.669819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7b462-ef90-42b8-8b20-26ea6cb47eb8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:07.673782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:07.709560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95aba0-f680-4373-821c-b3e0aed8bae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:07.710021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95aba0-f680-4373-821c-b3e0aed8bae5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.710299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95aba0-f680-4373-821c-b3e0aed8bae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.710571 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95aba0-f680-4373-821c-b3e0aed8bae5 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.711352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95aba0-f680-4373-821c-b3e0aed8bae5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:07.711662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95aba0-f680-4373-821c-b3e0aed8bae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:07.713125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95aba0-f680-4373-821c-b3e0aed8bae5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:07.718317 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 445/901] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:07.723778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95aba0-f680-4373-821c-b3e0aed8bae5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:07.740192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc0a5-8f16-4560-ba9f-b936e81ca1b2 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:07.778800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47afe8e-8982-47ac-9bee-71f6ae365d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:07.780337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47afe8e-8982-47ac-9bee-71f6ae365d3f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.780820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47afe8e-8982-47ac-9bee-71f6ae365d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.781288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47afe8e-8982-47ac-9bee-71f6ae365d3f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.791472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47afe8e-8982-47ac-9bee-71f6ae365d3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:07.793280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47afe8e-8982-47ac-9bee-71f6ae365d3f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-a47afe8e-8982-47ac-9bee-71f6ae365d3f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:55:07.809049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:07.810019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:07.810985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:07.810985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:07.810985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:55:07.810985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:55:07.810985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:55:07.810985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:55:07.810985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:55:07.810985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:55:07.810985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:55:07.810985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:07.818008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 457/902] 10.222.0.30 () {56 vars in 1117 bytes} [Mon May 23 17:55:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:07.819180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47afe8e-8982-47ac-9bee-71f6ae365d3f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:07.825379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:07.832923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95aba0-f680-4373-821c-b3e0aed8bae5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:07.870878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705314e-7c18-40c3-8753-64631529c26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:07.871663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705314e-7c18-40c3-8753-64631529c26d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.872026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705314e-7c18-40c3-8753-64631529c26d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.872397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705314e-7c18-40c3-8753-64631529c26d None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.873369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705314e-7c18-40c3-8753-64631529c26d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:07.874083 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705314e-7c18-40c3-8753-64631529c26d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:07.875846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705314e-7c18-40c3-8753-64631529c26d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:07.882476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 446/903] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:07.888398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705314e-7c18-40c3-8753-64631529c26d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:07.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47afe8e-8982-47ac-9bee-71f6ae365d3f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:07.961196 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:07.978615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06698423-a885-45dd-a064-08e7effe388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:07.979667 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06698423-a885-45dd-a064-08e7effe388c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:07.980210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06698423-a885-45dd-a064-08e7effe388c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:07.980687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06698423-a885-45dd-a064-08e7effe388c None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:07.981774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06698423-a885-45dd-a064-08e7effe388c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:07.982297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06698423-a885-45dd-a064-08e7effe388c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:07.983964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06698423-a885-45dd-a064-08e7effe388c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:07.994326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705314e-7c18-40c3-8753-64631529c26d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:08.004670 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 458/904] 10.222.0.30 () {56 vars in 1149 bytes} [Mon May 23 17:55:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:08.015691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06698423-a885-45dd-a064-08e7effe388c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:08.032460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684909da-5ef9-42e1-812d-bb639593d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:08.033451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684909da-5ef9-42e1-812d-bb639593d279 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:08.033594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684909da-5ef9-42e1-812d-bb639593d279 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:08.033757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684909da-5ef9-42e1-812d-bb639593d279 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:08.034537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684909da-5ef9-42e1-812d-bb639593d279 None admin] RBAC: Adding query filter params (interface=public, service_id=e38a6e281efd495596dcc47d28fc644a, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:08.034913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684909da-5ef9-42e1-812d-bb639593d279 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:08.036273 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684909da-5ef9-42e1-812d-bb639593d279 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:08.046737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 447/905] 10.222.0.30 () {56 vars in 1251 bytes} [Mon May 23 17:55:07 2022] GET /identity/v3/endpoints?service_id=e38a6e281efd495596dcc47d28fc644a&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:08.047844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684909da-5ef9-42e1-812d-bb639593d279 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:08.073360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:08.123517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06698423-a885-45dd-a064-08e7effe388c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:08.159774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51ec33-ea93-4cf8-9b0d-72c495cc3c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:08.160517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51ec33-ea93-4cf8-9b0d-72c495cc3c54 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:08.160871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51ec33-ea93-4cf8-9b0d-72c495cc3c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:08.161083 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684909da-5ef9-42e1-812d-bb639593d279 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:08.161233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51ec33-ea93-4cf8-9b0d-72c495cc3c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:08.199357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827b61c-7533-4510-a23f-339081446fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:08.200041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827b61c-7533-4510-a23f-339081446fbe None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:08.200364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827b61c-7533-4510-a23f-339081446fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:08.200661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827b61c-7533-4510-a23f-339081446fbe None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:08.201403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827b61c-7533-4510-a23f-339081446fbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:08.202923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827b61c-7533-4510-a23f-339081446fbe None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:08.210067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 448/906] 10.222.0.30 () {56 vars in 1087 bytes} [Mon May 23 17:55:08 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:55:08.218117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:08.236202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51ec33-ea93-4cf8-9b0d-72c495cc3c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:08.237719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51ec33-ea93-4cf8-9b0d-72c495cc3c54 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:08.351761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 459/907] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:08 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:55:08.357393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827b61c-7533-4510-a23f-339081446fbe None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:08.452047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:08.469209 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827b61c-7533-4510-a23f-339081446fbe None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:08.505968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f18ef9-aba3-4077-8a97-3fdef44bd709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:08.506791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f18ef9-aba3-4077-8a97-3fdef44bd709 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:08.507081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f18ef9-aba3-4077-8a97-3fdef44bd709 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:08.507360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f18ef9-aba3-4077-8a97-3fdef44bd709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:08.522416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f18ef9-aba3-4077-8a97-3fdef44bd709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:08.524579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f18ef9-aba3-4077-8a97-3fdef44bd709 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-a1f18ef9-aba3-4077-8a97-3fdef44bd709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:08.544271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:08.545226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:08.546124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:08.546124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:08.546124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:08.546124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:08.550075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 449/908] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:08.551455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51ec33-ea93-4cf8-9b0d-72c495cc3c54 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:08.636070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:08.659183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51ec33-ea93-4cf8-9b0d-72c495cc3c54 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:08.699910 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b80d89-fb74-4caf-95d8-0a338a07dbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:08.700574 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b80d89-fb74-4caf-95d8-0a338a07dbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:08.700859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b80d89-fb74-4caf-95d8-0a338a07dbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:08.701132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b80d89-fb74-4caf-95d8-0a338a07dbe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:08.701852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b80d89-fb74-4caf-95d8-0a338a07dbe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:08.702155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b80d89-fb74-4caf-95d8-0a338a07dbe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:08.703542 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b80d89-fb74-4caf-95d8-0a338a07dbe6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:08.715556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 460/909] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:08.721039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f18ef9-aba3-4077-8a97-3fdef44bd709 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:08.827479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f18ef9-aba3-4077-8a97-3fdef44bd709 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:08.863929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a077b0-c5d2-4a03-a26c-f3ce5310c1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:08.864867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a077b0-c5d2-4a03-a26c-f3ce5310c1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:08.865156 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a077b0-c5d2-4a03-a26c-f3ce5310c1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:08.865434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a077b0-c5d2-4a03-a26c-f3ce5310c1a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:08.874471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a077b0-c5d2-4a03-a26c-f3ce5310c1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:08.876023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a077b0-c5d2-4a03-a26c-f3ce5310c1a6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:08.878096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-67a077b0-c5d2-4a03-a26c-f3ce5310c1a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:55:08.897621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:08.899139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:08.900402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:55:08.900402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:55:08.900402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:55:08.900402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:55:08.900402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:55:08.900402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:55:08.900402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:08.900402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:08.905318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 450/910] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:08.906666 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b80d89-fb74-4caf-95d8-0a338a07dbe6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:09.016209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b80d89-fb74-4caf-95d8-0a338a07dbe6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:09.050972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d84c7c-2fdd-4dd3-9222-74c01bf7bee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:09.051643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d84c7c-2fdd-4dd3-9222-74c01bf7bee0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:09.051924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d84c7c-2fdd-4dd3-9222-74c01bf7bee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:09.052201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d84c7c-2fdd-4dd3-9222-74c01bf7bee0 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:09.052987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d84c7c-2fdd-4dd3-9222-74c01bf7bee0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:09.053295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d84c7c-2fdd-4dd3-9222-74c01bf7bee0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:09.054735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d84c7c-2fdd-4dd3-9222-74c01bf7bee0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:09.058783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0d3b3-8af8-456f-907f-e64d00c161c2 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:09.059077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0d3b3-8af8-456f-907f-e64d00c161c2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:09.059362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0d3b3-8af8-456f-907f-e64d00c161c2 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:09.061041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 451/911] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:09.066723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:09.068934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e6238-afcb-4338-9fef-eab087330206 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:09.069288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e6238-afcb-4338-9fef-eab087330206 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:09.069460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 461/912] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:55:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:09.070460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e6238-afcb-4338-9fef-eab087330206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:09.076536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d84c7c-2fdd-4dd3-9222-74c01bf7bee0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:09.090238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ec8e6238-afcb-4338-9fef-eab087330206 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:09.091822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ec8e6238-afcb-4338-9fef-eab087330206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:09.179416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 452/913] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:09.181111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d84c7c-2fdd-4dd3-9222-74c01bf7bee0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:09.202949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e6238-afcb-4338-9fef-eab087330206 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:09.217537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b4b11-784a-4c4a-a204-6acdfd799957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:09.218301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b4b11-784a-4c4a-a204-6acdfd799957 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:09.218591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b4b11-784a-4c4a-a204-6acdfd799957 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:09.218989 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b4b11-784a-4c4a-a204-6acdfd799957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:09.220108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b4b11-784a-4c4a-a204-6acdfd799957 None admin] RBAC: Adding query filter params (role.id=a25a64439bdc4250924866297524814c, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=3170dcaf527b44b8bd33cae78b39fb2f) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:09.220417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b4b11-784a-4c4a-a204-6acdfd799957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:09.221970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b4b11-784a-4c4a-a204-6acdfd799957 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:09.228120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 462/914] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:09 2022] GET /identity/v3/role_assignments?user.id=3170dcaf527b44b8bd33cae78b39fb2f&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=a25a64439bdc4250924866297524814c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:09.319984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e6238-afcb-4338-9fef-eab087330206 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:09.353851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:09.362582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92329d14-2a06-4704-b19e-535de6a1d7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:09.363422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329d14-2a06-4704-b19e-535de6a1d7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:09.363706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329d14-2a06-4704-b19e-535de6a1d7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:09.363979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329d14-2a06-4704-b19e-535de6a1d7e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:09.364636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92329d14-2a06-4704-b19e-535de6a1d7e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:09.366089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92329d14-2a06-4704-b19e-535de6a1d7e1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-92329d14-2a06-4704-b19e-535de6a1d7e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:09.379488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:09.380576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:09.381682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 453/915] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:55:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:09.389795 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b4b11-784a-4c4a-a204-6acdfd799957 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:09.466469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:09.509690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b4b11-784a-4c4a-a204-6acdfd799957 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:09.548883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d17c51-cc75-4826-8617-0b325af112ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:09.549553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d17c51-cc75-4826-8617-0b325af112ed None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:09.549837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d17c51-cc75-4826-8617-0b325af112ed None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:09.550169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d17c51-cc75-4826-8617-0b325af112ed None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:09.550986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d17c51-cc75-4826-8617-0b325af112ed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:09.551260 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d17c51-cc75-4826-8617-0b325af112ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:09.552624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d17c51-cc75-4826-8617-0b325af112ed None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:09.558227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 463/916] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:55:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:09.564002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92329d14-2a06-4704-b19e-535de6a1d7e1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:09.673964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92329d14-2a06-4704-b19e-535de6a1d7e1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:09.703443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee582be-6c62-4d6c-b389-b52b1d80932d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:09.703753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee582be-6c62-4d6c-b389-b52b1d80932d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:09.704002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee582be-6c62-4d6c-b389-b52b1d80932d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:09.707000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 464/917] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:09.711945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06be8bf-ca9a-40f2-9b63-86a387b93ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:09.712675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91772a48-016b-4e5d-9cc8-6acd06dc5299 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:09.712962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91772a48-016b-4e5d-9cc8-6acd06dc5299 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:09.713241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91772a48-016b-4e5d-9cc8-6acd06dc5299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:09.713591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06be8bf-ca9a-40f2-9b63-86a387b93ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:09.714073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06be8bf-ca9a-40f2-9b63-86a387b93ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:09.714564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06be8bf-ca9a-40f2-9b63-86a387b93ff6 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:09.715597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06be8bf-ca9a-40f2-9b63-86a387b93ff6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:09.716161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06be8bf-ca9a-40f2-9b63-86a387b93ff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:09.717813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06be8bf-ca9a-40f2-9b63-86a387b93ff6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:09.729652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 454/918] 10.222.0.30 () {56 vars in 1114 bytes} [Mon May 23 17:55:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:09.731166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06be8bf-ca9a-40f2-9b63-86a387b93ff6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:09.734372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-91772a48-016b-4e5d-9cc8-6acd06dc5299 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:09.735974 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-91772a48-016b-4e5d-9cc8-6acd06dc5299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:09.791439 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:09.819050 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 465/919] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:09.835550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91772a48-016b-4e5d-9cc8-6acd06dc5299 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:09.840040 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06be8bf-ca9a-40f2-9b63-86a387b93ff6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:09.878265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6035fca-0e8d-4ead-9559-35f04a62d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:09.879249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6035fca-0e8d-4ead-9559-35f04a62d97d None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:09.879721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6035fca-0e8d-4ead-9559-35f04a62d97d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:09.880203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6035fca-0e8d-4ead-9559-35f04a62d97d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:09.881136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6035fca-0e8d-4ead-9559-35f04a62d97d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:09.882780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6035fca-0e8d-4ead-9559-35f04a62d97d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:09.905062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:09.914991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 455/920] 10.222.0.30 () {60 vars in 1144 bytes} [Mon May 23 17:55:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:55:09.970172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91772a48-016b-4e5d-9cc8-6acd06dc5299 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:10.017286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282e67b-ef00-49e1-b111-bdd3e99333f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:10.018155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e67b-ef00-49e1-b111-bdd3e99333f6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:10.018442 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e67b-ef00-49e1-b111-bdd3e99333f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:10.018750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e67b-ef00-49e1-b111-bdd3e99333f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:10.019478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282e67b-ef00-49e1-b111-bdd3e99333f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:10.020869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282e67b-ef00-49e1-b111-bdd3e99333f6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-6282e67b-ef00-49e1-b111-bdd3e99333f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:10.034526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:10.035638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:10.036925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 466/921] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:10.043020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6035fca-0e8d-4ead-9559-35f04a62d97d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:10.162659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6035fca-0e8d-4ead-9559-35f04a62d97d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:10.177304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:10.203382 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9f27e-2eb0-471a-a677-3a783b629e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:10.204309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9f27e-2eb0-471a-a677-3a783b629e1e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:10.204598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9f27e-2eb0-471a-a677-3a783b629e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:10.204865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9f27e-2eb0-471a-a677-3a783b629e1e None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:10.205637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9f27e-2eb0-471a-a677-3a783b629e1e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:10.206195 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9f27e-2eb0-471a-a677-3a783b629e1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:10.208052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9f27e-2eb0-471a-a677-3a783b629e1e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:10.214207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 456/922] 10.222.0.30 () {56 vars in 1122 bytes} [Mon May 23 17:55:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:10.219821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282e67b-ef00-49e1-b111-bdd3e99333f6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:10.330998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282e67b-ef00-49e1-b111-bdd3e99333f6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:10.353425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:10.373417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063710de-0e94-4a2c-bd12-c81520df8b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:10.374074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063710de-0e94-4a2c-bd12-c81520df8b35 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:10.374379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063710de-0e94-4a2c-bd12-c81520df8b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:10.374652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063710de-0e94-4a2c-bd12-c81520df8b35 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:10.375391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063710de-0e94-4a2c-bd12-c81520df8b35 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:10.375701 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063710de-0e94-4a2c-bd12-c81520df8b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:10.377067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063710de-0e94-4a2c-bd12-c81520df8b35 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:10.382411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 467/923] 10.222.0.30 () {56 vars in 1122 bytes} [Mon May 23 17:55:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:10.389019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9f27e-2eb0-471a-a677-3a783b629e1e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:10.508776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9f27e-2eb0-471a-a677-3a783b629e1e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:10.545809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb547b5-3784-4679-9de2-36d6e1d3f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:10.546566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb547b5-3784-4679-9de2-36d6e1d3f15e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:10.546951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb547b5-3784-4679-9de2-36d6e1d3f15e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:10.547297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb547b5-3784-4679-9de2-36d6e1d3f15e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:10.548155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb547b5-3784-4679-9de2-36d6e1d3f15e None admin] RBAC: Adding query filter params (interface=public, service_id=e3296abe38344e39bdc315f6e08bed3c, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:10.548538 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb547b5-3784-4679-9de2-36d6e1d3f15e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:10.549980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb547b5-3784-4679-9de2-36d6e1d3f15e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:10.556019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 457/924] 10.222.0.30 () {56 vars in 1251 bytes} [Mon May 23 17:55:10 2022] GET /identity/v3/endpoints?service_id=e3296abe38344e39bdc315f6e08bed3c&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:10.563835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063710de-0e94-4a2c-bd12-c81520df8b35 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:10.636367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec90e-1b36-49fc-a806-d6deec2b62db None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:10.636759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec90e-1b36-49fc-a806-d6deec2b62db None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:10.637116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ec90e-1b36-49fc-a806-d6deec2b62db None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:10.638559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 458/925] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:10.645152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdbb74-1d93-4dec-b3da-4854776426f3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:10.645152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdbb74-1d93-4dec-b3da-4854776426f3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:10.645152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdbb74-1d93-4dec-b3da-4854776426f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:10.662019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-fbcdbb74-1d93-4dec-b3da-4854776426f3 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:10.663335 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fbcdbb74-1d93-4dec-b3da-4854776426f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:10.684817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063710de-0e94-4a2c-bd12-c81520df8b35 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:10.704788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:10.732097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679c8dc-3f27-498a-bec2-ea1cafbeabf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:10.732896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679c8dc-3f27-498a-bec2-ea1cafbeabf6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:10.733187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679c8dc-3f27-498a-bec2-ea1cafbeabf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:10.733708 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679c8dc-3f27-498a-bec2-ea1cafbeabf6 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:10.734809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679c8dc-3f27-498a-bec2-ea1cafbeabf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:10.736507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679c8dc-3f27-498a-bec2-ea1cafbeabf6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:10.743969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 468/926] 10.222.0.30 () {56 vars in 1087 bytes} [Mon May 23 17:55:10 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:55:10.746858 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 459/927] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:10.766762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679c8dc-3f27-498a-bec2-ea1cafbeabf6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:10.818963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:10.881768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679c8dc-3f27-498a-bec2-ea1cafbeabf6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:10.920977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1901b7c-6c23-4b9e-91f5-fac6485881a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:10.921711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1901b7c-6c23-4b9e-91f5-fac6485881a7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:10.921999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1901b7c-6c23-4b9e-91f5-fac6485881a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:10.922277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1901b7c-6c23-4b9e-91f5-fac6485881a7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:10.922968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1901b7c-6c23-4b9e-91f5-fac6485881a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:10.925444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1901b7c-6c23-4b9e-91f5-fac6485881a7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-f1901b7c-6c23-4b9e-91f5-fac6485881a7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:10.938862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:10.939854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:10.940705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 469/928] 10.222.0.30 () {56 vars in 1132 bytes} [Mon May 23 17:55:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:10.946733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdbb74-1d93-4dec-b3da-4854776426f3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:11.062485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdbb74-1d93-4dec-b3da-4854776426f3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:11.099452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2a589-b497-4d5c-ba93-5596b0e20f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:11.100128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2a589-b497-4d5c-ba93-5596b0e20f6e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:11.100412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2a589-b497-4d5c-ba93-5596b0e20f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:11.100691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2a589-b497-4d5c-ba93-5596b0e20f6e None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:11.101403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2a589-b497-4d5c-ba93-5596b0e20f6e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:11.101740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2a589-b497-4d5c-ba93-5596b0e20f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:11.103163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2a589-b497-4d5c-ba93-5596b0e20f6e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:11.108561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 460/929] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:11.113875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1901b7c-6c23-4b9e-91f5-fac6485881a7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:11.225608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1901b7c-6c23-4b9e-91f5-fac6485881a7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:11.235842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:11.262023 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01454e18-01a3-4ab7-86e1-a4a084ad1613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:11.262789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01454e18-01a3-4ab7-86e1-a4a084ad1613 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:11.263078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01454e18-01a3-4ab7-86e1-a4a084ad1613 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:11.263360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01454e18-01a3-4ab7-86e1-a4a084ad1613 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:11.264082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01454e18-01a3-4ab7-86e1-a4a084ad1613 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:11.264393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01454e18-01a3-4ab7-86e1-a4a084ad1613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:11.265767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01454e18-01a3-4ab7-86e1-a4a084ad1613 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:11.271427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 470/930] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:11.277233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2a589-b497-4d5c-ba93-5596b0e20f6e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:11.319572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:11.394965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2a589-b497-4d5c-ba93-5596b0e20f6e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:11.432028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7e69b-4e4f-426d-9f4a-548be5b765e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:11.433020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7e69b-4e4f-426d-9f4a-548be5b765e1 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:11.433530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7e69b-4e4f-426d-9f4a-548be5b765e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:11.433990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7e69b-4e4f-426d-9f4a-548be5b765e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:11.435063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7e69b-4e4f-426d-9f4a-548be5b765e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:11.436676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7e69b-4e4f-426d-9f4a-548be5b765e1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:11.461719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 461/931] 10.222.0.30 () {60 vars in 1144 bytes} [Mon May 23 17:55:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:55:11.640878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aab99f-fd73-4f05-9f91-7f19886f6a20 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:11.641169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aab99f-fd73-4f05-9f91-7f19886f6a20 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:11.641450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aab99f-fd73-4f05-9f91-7f19886f6a20 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:11.642852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 471/932] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:11.648572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f84d9c-4430-46ea-bb6a-08c156c0263a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:11.648874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f84d9c-4430-46ea-bb6a-08c156c0263a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:11.649232 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f84d9c-4430-46ea-bb6a-08c156c0263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:11.667292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e0f84d9c-4430-46ea-bb6a-08c156c0263a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:11.668490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e0f84d9c-4430-46ea-bb6a-08c156c0263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:11.746491 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 462/933] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:11.768191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aab99f-fd73-4f05-9f91-7f19886f6a20 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:11.876123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aab99f-fd73-4f05-9f91-7f19886f6a20 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:11.910828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5501b-60f9-47fa-9e21-0c8bc8695eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:11.911642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5501b-60f9-47fa-9e21-0c8bc8695eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:11.911917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5501b-60f9-47fa-9e21-0c8bc8695eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:11.912182 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5501b-60f9-47fa-9e21-0c8bc8695eb9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:11.922975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5501b-60f9-47fa-9e21-0c8bc8695eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-e9b5501b-60f9-47fa-9e21-0c8bc8695eb9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:11.931529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:11.932466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:11.933464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 472/934] 10.222.0.30 () {56 vars in 1120 bytes} [Mon May 23 17:55:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:11.938487 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f84d9c-4430-46ea-bb6a-08c156c0263a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:11.957026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:12.049848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f84d9c-4430-46ea-bb6a-08c156c0263a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:12.087602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c4ec-ba37-4ab0-9177-26a448dcb63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:12.088270 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c4ec-ba37-4ab0-9177-26a448dcb63f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:12.088554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c4ec-ba37-4ab0-9177-26a448dcb63f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:12.088827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c4ec-ba37-4ab0-9177-26a448dcb63f None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:12.089576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c4ec-ba37-4ab0-9177-26a448dcb63f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:12.089881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c4ec-ba37-4ab0-9177-26a448dcb63f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:12.091277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c4ec-ba37-4ab0-9177-26a448dcb63f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:12.100154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 463/935] 10.222.0.30 () {56 vars in 1115 bytes} [Mon May 23 17:55:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:12.106070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5501b-60f9-47fa-9e21-0c8bc8695eb9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:12.147339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:12.226393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5501b-60f9-47fa-9e21-0c8bc8695eb9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:12.265484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b9471-764d-4212-a2e2-aff9fbca37a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:12.266297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9471-764d-4212-a2e2-aff9fbca37a8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:12.266582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9471-764d-4212-a2e2-aff9fbca37a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:12.266888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9471-764d-4212-a2e2-aff9fbca37a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:12.279665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b9471-764d-4212-a2e2-aff9fbca37a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:12.281216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b9471-764d-4212-a2e2-aff9fbca37a8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1d9b9471-764d-4212-a2e2-aff9fbca37a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:12.300194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:12.301197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:12.302637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:12.302637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:12.302637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:12.302637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:12.302637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 473/936] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:12.307803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c4ec-ba37-4ab0-9177-26a448dcb63f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:12.376710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed7a86-97eb-43e8-b393-814fc456650d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:12.377357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed7a86-97eb-43e8-b393-814fc456650d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:12.377700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed7a86-97eb-43e8-b393-814fc456650d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:12.380653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 474/937] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:12.385147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e932a5-aa51-43d1-bd36-c3fd8947597c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:12.385508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e932a5-aa51-43d1-bd36-c3fd8947597c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:12.385861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e932a5-aa51-43d1-bd36-c3fd8947597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:12.392876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:12.404914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-04e932a5-aa51-43d1-bd36-c3fd8947597c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:12.406125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-04e932a5-aa51-43d1-bd36-c3fd8947597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:12.420403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c4ec-ba37-4ab0-9177-26a448dcb63f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:12.457573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65841c0-4c5c-4950-8f49-a4896fe6b42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:12.458348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65841c0-4c5c-4950-8f49-a4896fe6b42e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:12.458715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65841c0-4c5c-4950-8f49-a4896fe6b42e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:12.459081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65841c0-4c5c-4950-8f49-a4896fe6b42e None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:12.459876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65841c0-4c5c-4950-8f49-a4896fe6b42e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:12.460252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65841c0-4c5c-4950-8f49-a4896fe6b42e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:12.462002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65841c0-4c5c-4950-8f49-a4896fe6b42e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:12.475146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 464/938] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:12.481319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65841c0-4c5c-4950-8f49-a4896fe6b42e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:12.492957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 475/939] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:12.524503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e932a5-aa51-43d1-bd36-c3fd8947597c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:12.541926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:12.609476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65841c0-4c5c-4950-8f49-a4896fe6b42e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:12.645046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e932a5-aa51-43d1-bd36-c3fd8947597c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:12.645852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af124b1-2026-49c4-8161-6775dcf91cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:12.646670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af124b1-2026-49c4-8161-6775dcf91cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:12.646983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af124b1-2026-49c4-8161-6775dcf91cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:12.647258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af124b1-2026-49c4-8161-6775dcf91cb3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:12.655168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af124b1-2026-49c4-8161-6775dcf91cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:12.656557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af124b1-2026-49c4-8161-6775dcf91cb3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:12.658792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5af124b1-2026-49c4-8161-6775dcf91cb3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:55:12.677117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:12.678177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:12.680384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 465/940] 10.222.0.30 () {56 vars in 1117 bytes} [Mon May 23 17:55:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:12.684827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af124b1-2026-49c4-8161-6775dcf91cb3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:12.696159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:12.696885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:12.697165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:12.697490 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:12.698212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:12.700159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:12.701964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: WARNING keystone.server.flask.common [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 17:55:12.724995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.sql.core [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 17:55:12.724995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 17:55:12.724995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [parameters: {'id': 'a65a86ef988b4566be58e90ca13b9bcc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 17:55:12.724995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80381) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a65a86ef988b4566be58e90ca13b9bcc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a65a86ef988b4566be58e90ca13b9bcc. May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application conn.query(q) May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:55:12.736095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result.read() May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 23 17:55:12.736947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return project_ref.to_dict() May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application next(self.gen) May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application yield resource May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application next(self.gen) May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.session.rollback() May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.force_reraise() May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise self.value May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application session.commit() May 23 17:55:12.737921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._prepare_impl() May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.session.flush() May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._flush(objects) May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application compat.raise_( May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application flush_context.execute() May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 17:55:12.739482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rec.execute(self) May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 17:55:12.740408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application conn.query(q) May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result.read() May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:55:12.741213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [parameters: {'id': 'a65a86ef988b4566be58e90ca13b9bcc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:12.743820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:12.745744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:12.748026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:12.748026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 23 17:55:12.748026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 23 17:55:12.748026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:12.748026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:12.748026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 23 17:55:12.748026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.Conflict( May 23 17:55:12.748026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a65a86ef988b4566be58e90ca13b9bcc. May 23 17:55:12.748026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:12.748026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 476/941] 10.222.0.30 () {60 vars in 1140 bytes} [Mon May 23 17:55:12 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:12.749311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:12.837515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af124b1-2026-49c4-8161-6775dcf91cb3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:12.844778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:12.872702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24748eb1-07d6-4459-a343-6eb3927d4349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:12.873389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24748eb1-07d6-4459-a343-6eb3927d4349 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:12.873653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24748eb1-07d6-4459-a343-6eb3927d4349 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:12.873928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24748eb1-07d6-4459-a343-6eb3927d4349 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:12.874807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24748eb1-07d6-4459-a343-6eb3927d4349 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:12.875383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24748eb1-07d6-4459-a343-6eb3927d4349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:12.876539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24748eb1-07d6-4459-a343-6eb3927d4349 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:12.885770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684187d-eafe-4d69-a309-7cbb1e31877a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:12.904699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 466/942] 10.222.0.30 () {56 vars in 1149 bytes} [Mon May 23 17:55:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:12.908265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24748eb1-07d6-4459-a343-6eb3927d4349 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:12.932303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400702d8-09ff-4044-81ad-86952194f006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:12.933522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400702d8-09ff-4044-81ad-86952194f006 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:12.934037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400702d8-09ff-4044-81ad-86952194f006 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:12.934536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400702d8-09ff-4044-81ad-86952194f006 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:12.943063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400702d8-09ff-4044-81ad-86952194f006 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:12.945794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400702d8-09ff-4044-81ad-86952194f006 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-400702d8-09ff-4044-81ad-86952194f006 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:55:12.963316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:12.964297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:12.965216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:55:12.965216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:55:12.965216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:55:12.965216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:55:12.965216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:55:12.965216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:55:12.965216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:12.965216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:12.967914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 477/943] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:12.973683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400702d8-09ff-4044-81ad-86952194f006 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:12.991994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:13.036813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24748eb1-07d6-4459-a343-6eb3927d4349 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:13.071728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45259d1-cdb1-41e8-b233-2a5420e699a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:13.072451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45259d1-cdb1-41e8-b233-2a5420e699a0 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.072733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45259d1-cdb1-41e8-b233-2a5420e699a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.073009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45259d1-cdb1-41e8-b233-2a5420e699a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.083707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45259d1-cdb1-41e8-b233-2a5420e699a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:13.085075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45259d1-cdb1-41e8-b233-2a5420e699a0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:13.092072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400702d8-09ff-4044-81ad-86952194f006 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f45259d1-cdb1-41e8-b233-2a5420e699a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:13.104783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:13.105739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:13.106644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:13.106644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:13.106644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:13.106644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:13.110361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 467/944] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:13.111751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d501ed-c270-44d0-98d2-ff3087b8d5bd None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.112038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d501ed-c270-44d0-98d2-ff3087b8d5bd None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.112317 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d501ed-c270-44d0-98d2-ff3087b8d5bd None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.113769 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 468/945] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:13.114338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d501ed-c270-44d0-98d2-ff3087b8d5bd None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:13.129727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:13.137021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fd1eb-48b5-4402-8b4d-fad55fa8ea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:13.137683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd1eb-48b5-4402-8b4d-fad55fa8ea1d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.137969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd1eb-48b5-4402-8b4d-fad55fa8ea1d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.138246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd1eb-48b5-4402-8b4d-fad55fa8ea1d None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.139045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fd1eb-48b5-4402-8b4d-fad55fa8ea1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:13.139353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fd1eb-48b5-4402-8b4d-fad55fa8ea1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:13.140786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fd1eb-48b5-4402-8b4d-fad55fa8ea1d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:13.161165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 478/946] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:55:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:13.162423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261efbb-f05e-4238-b814-e382aeefa00b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.162724 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261efbb-f05e-4238-b814-e382aeefa00b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.163012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261efbb-f05e-4238-b814-e382aeefa00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.191945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a261efbb-f05e-4238-b814-e382aeefa00b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:13.194409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a261efbb-f05e-4238-b814-e382aeefa00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:13.247932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d501ed-c270-44d0-98d2-ff3087b8d5bd None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:13.260866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:13.296253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 479/947] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:13.313245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d770-b4d9-425d-9caf-20824b675b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:13.314331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d770-b4d9-425d-9caf-20824b675b49 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.314838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d770-b4d9-425d-9caf-20824b675b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.315326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d770-b4d9-425d-9caf-20824b675b49 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.316325 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450d770-b4d9-425d-9caf-20824b675b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:13.316862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450d770-b4d9-425d-9caf-20824b675b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:13.318484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450d770-b4d9-425d-9caf-20824b675b49 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:13.324758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261efbb-f05e-4238-b814-e382aeefa00b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:13.333917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 469/948] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:13.340058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d770-b4d9-425d-9caf-20824b675b49 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:13.460510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d770-b4d9-425d-9caf-20824b675b49 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:13.467006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261efbb-f05e-4238-b814-e382aeefa00b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:13.493991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:13.497928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac4c5-631c-41ab-887f-32f5676778ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:13.498782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac4c5-631c-41ab-887f-32f5676778ff None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.499047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac4c5-631c-41ab-887f-32f5676778ff None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.499322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac4c5-631c-41ab-887f-32f5676778ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.512360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ac4c5-631c-41ab-887f-32f5676778ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:13.514401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ac4c5-631c-41ab-887f-32f5676778ff None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:13.519190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440ae1d-7ae7-4f85-a767-8df206312778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:13.520017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ae1d-7ae7-4f85-a767-8df206312778 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.520302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ae1d-7ae7-4f85-a767-8df206312778 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.520581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ae1d-7ae7-4f85-a767-8df206312778 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.521249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440ae1d-7ae7-4f85-a767-8df206312778 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:13.522625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440ae1d-7ae7-4f85-a767-8df206312778 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-aa1ac4c5-631c-41ab-887f-32f5676778ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:55:13.536051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:13.536964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:13.537852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:55:13.537852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:55:13.537852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:55:13.537852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:55:13.537852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:55:13.537852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:55:13.537852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:13.537852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b440ae1d-7ae7-4f85-a767-8df206312778 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:13.539962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:13.540903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:13.542288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 480/949] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:13.548208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 470/950] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:13.549266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440ae1d-7ae7-4f85-a767-8df206312778 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:13.551633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac4c5-631c-41ab-887f-32f5676778ff None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:13.587423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:13.681871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac4c5-631c-41ab-887f-32f5676778ff None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:13.684194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440ae1d-7ae7-4f85-a767-8df206312778 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:13.720618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a47367-2012-4def-b553-ace8a41ce2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:13.721621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a47367-2012-4def-b553-ace8a41ce2ab None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.722102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a47367-2012-4def-b553-ace8a41ce2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.722640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a47367-2012-4def-b553-ace8a41ce2ab None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.723727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a47367-2012-4def-b553-ace8a41ce2ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:13.724304 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a47367-2012-4def-b553-ace8a41ce2ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:13.725487 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b9900-0fc0-44ed-bda7-682f71e3199a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:13.726154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b9900-0fc0-44ed-bda7-682f71e3199a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.726439 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b9900-0fc0-44ed-bda7-682f71e3199a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.727327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a47367-2012-4def-b553-ace8a41ce2ab None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:13.727930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b9900-0fc0-44ed-bda7-682f71e3199a None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.728116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b9900-0fc0-44ed-bda7-682f71e3199a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:13.728433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b9900-0fc0-44ed-bda7-682f71e3199a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:13.730156 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b9900-0fc0-44ed-bda7-682f71e3199a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:13.738208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 481/951] 10.222.0.30 () {56 vars in 1122 bytes} [Mon May 23 17:55:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:13.742853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a47367-2012-4def-b553-ace8a41ce2ab None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:13.750538 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 471/952] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:13.756528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b9900-0fc0-44ed-bda7-682f71e3199a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:13.806511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:13.856471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:13.866179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a47367-2012-4def-b553-ace8a41ce2ab None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:13.873589 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b9900-0fc0-44ed-bda7-682f71e3199a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:13.903059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ce2c6-d351-49f8-8e08-e7243f5afd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:13.903732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce2c6-d351-49f8-8e08-e7243f5afd75 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.904010 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce2c6-d351-49f8-8e08-e7243f5afd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.904286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce2c6-d351-49f8-8e08-e7243f5afd75 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.904997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ce2c6-d351-49f8-8e08-e7243f5afd75 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:13.905304 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ce2c6-d351-49f8-8e08-e7243f5afd75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:13.906664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ce2c6-d351-49f8-8e08-e7243f5afd75 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:13.909432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26accf-0be8-4c52-9075-fa1edf77ba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:13.910313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26accf-0be8-4c52-9075-fa1edf77ba0b None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.910592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26accf-0be8-4c52-9075-fa1edf77ba0b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.910893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26accf-0be8-4c52-9075-fa1edf77ba0b None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/3170dcaf527b44b8bd33cae78b39fb2f/roles/a25a64439bdc4250924866297524814c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.917230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 482/953] 10.222.0.30 () {56 vars in 1122 bytes} [Mon May 23 17:55:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:13.917230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a088467-3df4-4ea3-aedf-5fe86154fc6a None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.917230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a088467-3df4-4ea3-aedf-5fe86154fc6a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.917230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a088467-3df4-4ea3-aedf-5fe86154fc6a None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.917230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 483/954] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:13.918486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26accf-0be8-4c52-9075-fa1edf77ba0b None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=3170dcaf527b44b8bd33cae78b39fb2f, role_id=a25a64439bdc4250924866297524814c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:13.919518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a088467-3df4-4ea3-aedf-5fe86154fc6a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:13.920042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26accf-0be8-4c52-9075-fa1edf77ba0b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:13.946818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 472/955] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:55:13 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/3170dcaf527b44b8bd33cae78b39fb2f/roles/a25a64439bdc4250924866297524814c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:55:13.949562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c5771-8fa4-4bde-83db-c2ed48702e6a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:13.950055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c5771-8fa4-4bde-83db-c2ed48702e6a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:13.950630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c5771-8fa4-4bde-83db-c2ed48702e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:13.976214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ce7c5771-8fa4-4bde-83db-c2ed48702e6a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:13.978221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ce7c5771-8fa4-4bde-83db-c2ed48702e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:14.063079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 473/956] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:14.063702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a088467-3df4-4ea3-aedf-5fe86154fc6a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:14.080160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:14.081931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c5771-8fa4-4bde-83db-c2ed48702e6a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:14.111801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4402da-c50c-4288-a2ad-0da934886ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:14.112667 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4402da-c50c-4288-a2ad-0da934886ed7 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:14.113408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4402da-c50c-4288-a2ad-0da934886ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:14.113788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4402da-c50c-4288-a2ad-0da934886ed7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:14.114967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4402da-c50c-4288-a2ad-0da934886ed7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:14.116604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4402da-c50c-4288-a2ad-0da934886ed7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:14.151530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 484/957] 10.222.0.30 () {60 vars in 1144 bytes} [Mon May 23 17:55:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:55:14.196287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:14.223551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c5771-8fa4-4bde-83db-c2ed48702e6a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:14.270578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39522b-960d-4e5c-a6a6-cb36b9abdf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:14.271332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39522b-960d-4e5c-a6a6-cb36b9abdf7c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:14.271709 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39522b-960d-4e5c-a6a6-cb36b9abdf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:14.271991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39522b-960d-4e5c-a6a6-cb36b9abdf7c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:14.272647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39522b-960d-4e5c-a6a6-cb36b9abdf7c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:14.275069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39522b-960d-4e5c-a6a6-cb36b9abdf7c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-9e39522b-960d-4e5c-a6a6-cb36b9abdf7c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:14.288044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:14.289927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:14.291593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 474/958] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:14.296764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4402da-c50c-4288-a2ad-0da934886ed7 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:14.404102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4402da-c50c-4288-a2ad-0da934886ed7 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:14.439546 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbab6bf-0a4f-4ed3-8bda-a619fdf33134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:14.440219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab6bf-0a4f-4ed3-8bda-a619fdf33134 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:14.440552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab6bf-0a4f-4ed3-8bda-a619fdf33134 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:14.440835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab6bf-0a4f-4ed3-8bda-a619fdf33134 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:14.441538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbab6bf-0a4f-4ed3-8bda-a619fdf33134 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:14.441843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbab6bf-0a4f-4ed3-8bda-a619fdf33134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:14.443242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbab6bf-0a4f-4ed3-8bda-a619fdf33134 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:14.449214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 485/959] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:55:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:14.454750 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39522b-960d-4e5c-a6a6-cb36b9abdf7c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:14.562971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39522b-960d-4e5c-a6a6-cb36b9abdf7c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:14.597599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444f2dd-52d9-49bc-a159-6afd69a9db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:14.598268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444f2dd-52d9-49bc-a159-6afd69a9db83 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:14.598596 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444f2dd-52d9-49bc-a159-6afd69a9db83 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:14.598905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444f2dd-52d9-49bc-a159-6afd69a9db83 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:14.599611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444f2dd-52d9-49bc-a159-6afd69a9db83 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:14.599987 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444f2dd-52d9-49bc-a159-6afd69a9db83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:14.601370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444f2dd-52d9-49bc-a159-6afd69a9db83 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:14.610553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 475/960] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:55:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:15.622216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5b59f-6a6d-4ae3-88ff-34759a844749 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:15.623283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5b59f-6a6d-4ae3-88ff-34759a844749 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:15.623768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5b59f-6a6d-4ae3-88ff-34759a844749 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:15.625631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 486/961] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:15.631032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2560af-fca8-4bb2-802e-33844538e397 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:15.631833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2560af-fca8-4bb2-802e-33844538e397 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:15.632309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2560af-fca8-4bb2-802e-33844538e397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:15.637934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:15.652472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ad2560af-fca8-4bb2-802e-33844538e397 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:15.653920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ad2560af-fca8-4bb2-802e-33844538e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:15.723727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 476/962] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:15.748502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5b59f-6a6d-4ae3-88ff-34759a844749 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:15.781419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:15.865178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5b59f-6a6d-4ae3-88ff-34759a844749 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:15.901836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0de7be-e12a-4a7b-8b3c-3665e4284102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:15.902512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0de7be-e12a-4a7b-8b3c-3665e4284102 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:15.902831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0de7be-e12a-4a7b-8b3c-3665e4284102 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:15.903106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0de7be-e12a-4a7b-8b3c-3665e4284102 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:15.903804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0de7be-e12a-4a7b-8b3c-3665e4284102 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:15.905221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0de7be-e12a-4a7b-8b3c-3665e4284102 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:15.922400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.sql.core [None req-1b0de7be-e12a-4a7b-8b3c-3665e4284102 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 17:55:15.922400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 17:55:15.922400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [parameters: {'user_id': '9e380ffa0860433a9bb9b776e84445b4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 17:55:15.922400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80381) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1b0de7be-e12a-4a7b-8b3c-3665e4284102 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application conn.query(q) May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result.read() May 23 17:55:15.930975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:55:15.931883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application next(self.gen) May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application yield resource May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application next(self.gen) May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.session.rollback() May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.force_reraise() May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise self.value May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application session.commit() May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 17:55:15.933317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._prepare_impl() May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.session.flush() May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._flush(objects) May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application compat.raise_( May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application flush_context.execute() May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rec.execute(self) May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 17:55:15.934408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = connection._execute_20( May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 17:55:15.936419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result = self._query(query) May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application conn.query(q) May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application result.read() May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 17:55:15.938408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [parameters: {'user_id': '9e380ffa0860433a9bb9b776e84445b4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:15.944570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 23 17:55:15.946654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 23 17:55:15.948847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 23 17:55:15.948847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 23 17:55:15.948847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 17:55:15.948847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 17:55:15.948847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 17:55:15.948847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:15.948847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 487/963] 10.222.0.30 () {60 vars in 1131 bytes} [Mon May 23 17:55:15 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:15.953556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2560af-fca8-4bb2-802e-33844538e397 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:16.064466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2560af-fca8-4bb2-802e-33844538e397 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:16.095801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:16.107418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78e428-f3fb-44fb-8c76-560915b40054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:16.108230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78e428-f3fb-44fb-8c76-560915b40054 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:16.108513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78e428-f3fb-44fb-8c76-560915b40054 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:16.108784 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78e428-f3fb-44fb-8c76-560915b40054 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:16.116180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78e428-f3fb-44fb-8c76-560915b40054 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:16.117967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78e428-f3fb-44fb-8c76-560915b40054 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ef78e428-f3fb-44fb-8c76-560915b40054 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:55:16.132545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:16.134662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:16.136280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 477/964] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:55:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:16.143244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0de7be-e12a-4a7b-8b3c-3665e4284102 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:16.235605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121cfe-3c24-415c-891d-3bee30d6964e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:16.235928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121cfe-3c24-415c-891d-3bee30d6964e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:16.236165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121cfe-3c24-415c-891d-3bee30d6964e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:16.237830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 478/965] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:55:16.239828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:16.243644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acdd3b-c98d-4603-b35f-6a61393d7811 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:16.243953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acdd3b-c98d-4603-b35f-6a61393d7811 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:16.244821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acdd3b-c98d-4603-b35f-6a61393d7811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:16.247679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0de7be-e12a-4a7b-8b3c-3665e4284102 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:16.268328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a2acdd3b-c98d-4603-b35f-6a61393d7811 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:16.269522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a2acdd3b-c98d-4603-b35f-6a61393d7811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:16.285350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b27cb-da79-4587-ad86-ea109a646e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:16.286031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b27cb-da79-4587-ad86-ea109a646e44 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:16.286315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b27cb-da79-4587-ad86-ea109a646e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:16.286662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b27cb-da79-4587-ad86-ea109a646e44 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:16.287438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b27cb-da79-4587-ad86-ea109a646e44 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:16.287745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b27cb-da79-4587-ad86-ea109a646e44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:16.289902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b27cb-da79-4587-ad86-ea109a646e44 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:16.335347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 488/966] 10.222.0.30 () {56 vars in 1101 bytes} [Mon May 23 17:55:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:16.370059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 479/967] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:16.394060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b27cb-da79-4587-ad86-ea109a646e44 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:16.513822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b27cb-da79-4587-ad86-ea109a646e44 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:16.533332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7846-62c7-42ff-bde9-fbec481d5c23 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:16.533642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7846-62c7-42ff-bde9-fbec481d5c23 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:16.533908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7846-62c7-42ff-bde9-fbec481d5c23 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:16.536332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 480/968] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:16.546057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951a1ae-5c53-4199-9455-772e3ab17d54 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:16.546639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951a1ae-5c53-4199-9455-772e3ab17d54 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:16.547388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951a1ae-5c53-4199-9455-772e3ab17d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:16.559291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231d2e1-1c47-492f-b9e8-7c974996f833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:16.560442 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231d2e1-1c47-492f-b9e8-7c974996f833 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:16.560442 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231d2e1-1c47-492f-b9e8-7c974996f833 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:16.560709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231d2e1-1c47-492f-b9e8-7c974996f833 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:16.567301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1951a1ae-5c53-4199-9455-772e3ab17d54 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:16.568590 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1951a1ae-5c53-4199-9455-772e3ab17d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:16.573966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231d2e1-1c47-492f-b9e8-7c974996f833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1231d2e1-1c47-492f-b9e8-7c974996f833 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:16.582221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:16.583236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:16.584849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 489/969] 10.222.0.30 () {56 vars in 1120 bytes} [Mon May 23 17:55:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:16.591331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231d2e1-1c47-492f-b9e8-7c974996f833 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:16.608452 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:16.673106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 481/970] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:16.698358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951a1ae-5c53-4199-9455-772e3ab17d54 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:16.714402 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231d2e1-1c47-492f-b9e8-7c974996f833 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:16.748559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c789bc-afa3-499f-8caf-b329170c15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:16.749215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c789bc-afa3-499f-8caf-b329170c15b8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:16.749494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c789bc-afa3-499f-8caf-b329170c15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:16.749770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c789bc-afa3-499f-8caf-b329170c15b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:16.750503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c789bc-afa3-499f-8caf-b329170c15b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:16.750836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c789bc-afa3-499f-8caf-b329170c15b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:16.752190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c789bc-afa3-499f-8caf-b329170c15b8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:16.753422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:16.762585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 490/971] 10.222.0.30 () {56 vars in 1115 bytes} [Mon May 23 17:55:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:16.768135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c789bc-afa3-499f-8caf-b329170c15b8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:16.814009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951a1ae-5c53-4199-9455-772e3ab17d54 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:16.854467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a776-58d0-4335-ae0b-05a1dbf2caf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:16.854680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:16.855323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a776-58d0-4335-ae0b-05a1dbf2caf3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:16.855545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a776-58d0-4335-ae0b-05a1dbf2caf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:16.855826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a776-58d0-4335-ae0b-05a1dbf2caf3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:16.856551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3a776-58d0-4335-ae0b-05a1dbf2caf3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:16.857988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3a776-58d0-4335-ae0b-05a1dbf2caf3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-54f3a776-58d0-4335-ae0b-05a1dbf2caf3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:16.872177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:16.873193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:16.874036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 482/972] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:16.879294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a776-58d0-4335-ae0b-05a1dbf2caf3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:16.887978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c789bc-afa3-499f-8caf-b329170c15b8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:16.921208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a27b0a-a610-45d9-aced-17a5e0a5d1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:16.922013 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a27b0a-a610-45d9-aced-17a5e0a5d1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:16.922297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a27b0a-a610-45d9-aced-17a5e0a5d1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:16.922571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a27b0a-a610-45d9-aced-17a5e0a5d1c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:16.934211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a27b0a-a610-45d9-aced-17a5e0a5d1c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:16.935691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a27b0a-a610-45d9-aced-17a5e0a5d1c1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-75a27b0a-a610-45d9-aced-17a5e0a5d1c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:16.954226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:16.955309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:16.956198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:16.956198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:16.956198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:16.956198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:16.959009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 491/973] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:16.961577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a27b0a-a610-45d9-aced-17a5e0a5d1c1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:16.987084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3a776-58d0-4335-ae0b-05a1dbf2caf3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:17.003351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:17.021944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55918ed-20bb-457a-ab4f-64cbfa08b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:17.022612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55918ed-20bb-457a-ab4f-64cbfa08b326 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.022925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55918ed-20bb-457a-ab4f-64cbfa08b326 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.023264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55918ed-20bb-457a-ab4f-64cbfa08b326 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.024646 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55918ed-20bb-457a-ab4f-64cbfa08b326 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:17.024955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55918ed-20bb-457a-ab4f-64cbfa08b326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:17.026321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55918ed-20bb-457a-ab4f-64cbfa08b326 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:17.031009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 483/974] 10.222.0.30 () {56 vars in 1122 bytes} [Mon May 23 17:55:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:17.032209 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5be4-8e0d-4579-83b4-f0400752110a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.032499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5be4-8e0d-4579-83b4-f0400752110a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.032779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5be4-8e0d-4579-83b4-f0400752110a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.034008 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 484/975] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:17.038645 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5be4-8e0d-4579-83b4-f0400752110a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:17.065994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a27b0a-a610-45d9-aced-17a5e0a5d1c1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:17.091230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:17.101012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4dce-e088-4588-ac12-e66f7ad59b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:17.101735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4dce-e088-4588-ac12-e66f7ad59b10 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.102016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4dce-e088-4588-ac12-e66f7ad59b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.102289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4dce-e088-4588-ac12-e66f7ad59b10 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.103032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4dce-e088-4588-ac12-e66f7ad59b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:17.103331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4dce-e088-4588-ac12-e66f7ad59b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:17.104732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4dce-e088-4588-ac12-e66f7ad59b10 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:17.116160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 492/976] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:17.118025 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c483ab-8859-4b3e-93b7-1da02f583124 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.118311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c483ab-8859-4b3e-93b7-1da02f583124 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.118606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c483ab-8859-4b3e-93b7-1da02f583124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.135153 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f5c483ab-8859-4b3e-93b7-1da02f583124 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:17.136704 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f5c483ab-8859-4b3e-93b7-1da02f583124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:17.138843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5be4-8e0d-4579-83b4-f0400752110a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:17.171663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce5afb-ccea-40cb-8b8f-9c5e721d670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:17.172315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce5afb-ccea-40cb-8b8f-9c5e721d670b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.172597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce5afb-ccea-40cb-8b8f-9c5e721d670b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.172868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce5afb-ccea-40cb-8b8f-9c5e721d670b None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.173558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce5afb-ccea-40cb-8b8f-9c5e721d670b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:17.173860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce5afb-ccea-40cb-8b8f-9c5e721d670b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:17.175256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce5afb-ccea-40cb-8b8f-9c5e721d670b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:17.180980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 485/977] 10.222.0.30 () {56 vars in 1122 bytes} [Mon May 23 17:55:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:17.181749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce5afb-ccea-40cb-8b8f-9c5e721d670b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:17.206215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 493/978] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:17.207160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c483ab-8859-4b3e-93b7-1da02f583124 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:17.229354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:17.285742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce5afb-ccea-40cb-8b8f-9c5e721d670b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:17.319554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a370c44-8882-4a61-b545-3155dc1ce47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:17.320954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a370c44-8882-4a61-b545-3155dc1ce47e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.321236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a370c44-8882-4a61-b545-3155dc1ce47e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.321509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a370c44-8882-4a61-b545-3155dc1ce47e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.322122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c483ab-8859-4b3e-93b7-1da02f583124 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:17.329053 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a370c44-8882-4a61-b545-3155dc1ce47e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:17.330481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a370c44-8882-4a61-b545-3155dc1ce47e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:17.338488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-1a370c44-8882-4a61-b545-3155dc1ce47e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:55:17.345569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:17.346678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 486/979] 10.222.0.30 () {56 vars in 1117 bytes} [Mon May 23 17:55:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:17.354043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a370c44-8882-4a61-b545-3155dc1ce47e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:17.366727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156790d-bffc-48cb-9f5e-fa65a6137f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:17.367501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156790d-bffc-48cb-9f5e-fa65a6137f72 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.367803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156790d-bffc-48cb-9f5e-fa65a6137f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.368074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156790d-bffc-48cb-9f5e-fa65a6137f72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.368869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156790d-bffc-48cb-9f5e-fa65a6137f72 None admin] RBAC: Adding query filter params (interface=admin, service_id=e3296abe38344e39bdc315f6e08bed3c, region_id=RegionOne) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:17.369205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156790d-bffc-48cb-9f5e-fa65a6137f72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:17.370574 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156790d-bffc-48cb-9f5e-fa65a6137f72 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:17.377316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 494/980] 10.222.0.30 () {56 vars in 1249 bytes} [Mon May 23 17:55:17 2022] GET /identity/v3/endpoints?service_id=e3296abe38344e39bdc315f6e08bed3c&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:17.378107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156790d-bffc-48cb-9f5e-fa65a6137f72 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:17.457167 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a370c44-8882-4a61-b545-3155dc1ce47e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:17.459489 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:17.478360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156790d-bffc-48cb-9f5e-fa65a6137f72 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:17.491633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b780a-c5e6-476c-85b8-1bd7d23d01ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:17.492317 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b780a-c5e6-476c-85b8-1bd7d23d01ec None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.492661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b780a-c5e6-476c-85b8-1bd7d23d01ec None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.492881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b780a-c5e6-476c-85b8-1bd7d23d01ec None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.493600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b780a-c5e6-476c-85b8-1bd7d23d01ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:17.494997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b780a-c5e6-476c-85b8-1bd7d23d01ec None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:17.509059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 487/981] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:55:17 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:55:17.509863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b780a-c5e6-476c-85b8-1bd7d23d01ec None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:17.535250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cec81-021b-4d89-929a-5cc235906837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:17.535950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cec81-021b-4d89-929a-5cc235906837 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.536230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cec81-021b-4d89-929a-5cc235906837 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.536500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cec81-021b-4d89-929a-5cc235906837 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.537412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cec81-021b-4d89-929a-5cc235906837 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:17.537729 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cec81-021b-4d89-929a-5cc235906837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:17.539975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cec81-021b-4d89-929a-5cc235906837 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:17.565546 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 495/982] 10.222.0.30 () {56 vars in 1149 bytes} [Mon May 23 17:55:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:17.566861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cec81-021b-4d89-929a-5cc235906837 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:17.607642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:17.635412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b780a-c5e6-476c-85b8-1bd7d23d01ec None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:17.681214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94cb89-3c46-443b-9e71-49b059e4d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:17.682134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94cb89-3c46-443b-9e71-49b059e4d56b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.682547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94cb89-3c46-443b-9e71-49b059e4d56b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.683047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94cb89-3c46-443b-9e71-49b059e4d56b None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.683911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94cb89-3c46-443b-9e71-49b059e4d56b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:17.686110 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94cb89-3c46-443b-9e71-49b059e4d56b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:17.688586 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cec81-021b-4d89-929a-5cc235906837 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:17.693868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 488/983] 10.222.0.30 () {56 vars in 1087 bytes} [Mon May 23 17:55:17 2022] GET /identity/v3/services => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:55:17.740820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34e7f-6b63-40f4-a65f-7e9aecabe362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:17.741517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34e7f-6b63-40f4-a65f-7e9aecabe362 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:17.741772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34e7f-6b63-40f4-a65f-7e9aecabe362 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:17.742797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34e7f-6b63-40f4-a65f-7e9aecabe362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:17.821755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff34e7f-6b63-40f4-a65f-7e9aecabe362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:17.823276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff34e7f-6b63-40f4-a65f-7e9aecabe362 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:17.859861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:17.932411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 496/984] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:17 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:55:17.938305 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94cb89-3c46-443b-9e71-49b059e4d56b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:17.967430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:18.047429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94cb89-3c46-443b-9e71-49b059e4d56b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:18.084228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a1337-d873-4c9a-9b49-aea04eab6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:18.085360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a1337-d873-4c9a-9b49-aea04eab6f17 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:18.085839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a1337-d873-4c9a-9b49-aea04eab6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:18.086334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a1337-d873-4c9a-9b49-aea04eab6f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:18.098083 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a1337-d873-4c9a-9b49-aea04eab6f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:18.099847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a1337-d873-4c9a-9b49-aea04eab6f17 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-421a1337-d873-4c9a-9b49-aea04eab6f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:18.117737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:18.118718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:18.119744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:18.119744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:18.119744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:18.119744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:18.121607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 489/985] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:18.126951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34e7f-6b63-40f4-a65f-7e9aecabe362 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:18.231816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34e7f-6b63-40f4-a65f-7e9aecabe362 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:18.267048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5122ae-4b87-4299-914b-3248485d7444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:18.267705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5122ae-4b87-4299-914b-3248485d7444 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:18.267988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5122ae-4b87-4299-914b-3248485d7444 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:18.268261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5122ae-4b87-4299-914b-3248485d7444 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:18.268970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5122ae-4b87-4299-914b-3248485d7444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:18.269274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5122ae-4b87-4299-914b-3248485d7444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:18.270625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5122ae-4b87-4299-914b-3248485d7444 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:18.272234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:18.284007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 497/986] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:18.290612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a1337-d873-4c9a-9b49-aea04eab6f17 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:18.388786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:18.410211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a1337-d873-4c9a-9b49-aea04eab6f17 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:18.445812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8a11-2136-49a0-be16-726991437a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:18.446793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8a11-2136-49a0-be16-726991437a6d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:18.447184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8a11-2136-49a0-be16-726991437a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:18.447564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8a11-2136-49a0-be16-726991437a6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:18.454425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb8a11-2136-49a0-be16-726991437a6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:18.456007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb8a11-2136-49a0-be16-726991437a6d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-4ffb8a11-2136-49a0-be16-726991437a6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:55:18.470649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:18.471752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:18.472853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:55:18.472853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:55:18.472853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:55:18.472853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:55:18.472853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:55:18.472853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:55:18.472853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:18.472853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:18.479887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 490/987] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:18.481061 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5122ae-4b87-4299-914b-3248485d7444 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:18.588897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5122ae-4b87-4299-914b-3248485d7444 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:18.622410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530354c-f81f-4c40-9326-92493ab6f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:18.623107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530354c-f81f-4c40-9326-92493ab6f75e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:18.623393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530354c-f81f-4c40-9326-92493ab6f75e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:18.623673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530354c-f81f-4c40-9326-92493ab6f75e None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:18.624454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530354c-f81f-4c40-9326-92493ab6f75e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:18.624767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530354c-f81f-4c40-9326-92493ab6f75e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:18.626188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530354c-f81f-4c40-9326-92493ab6f75e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:18.640825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 498/988] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:18.644493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8a11-2136-49a0-be16-726991437a6d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:18.757378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8a11-2136-49a0-be16-726991437a6d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:18.793899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0385ed5-b0de-44d4-8fc0-bf968d295d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:18.794564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0385ed5-b0de-44d4-8fc0-bf968d295d51 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:18.794879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0385ed5-b0de-44d4-8fc0-bf968d295d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:18.795159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0385ed5-b0de-44d4-8fc0-bf968d295d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:18.795984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0385ed5-b0de-44d4-8fc0-bf968d295d51 None admin] RBAC: Adding query filter params (role.id=a25a64439bdc4250924866297524814c, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=3170dcaf527b44b8bd33cae78b39fb2f) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:18.796299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0385ed5-b0de-44d4-8fc0-bf968d295d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:18.797723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0385ed5-b0de-44d4-8fc0-bf968d295d51 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:18.810948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 491/989] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:18 2022] GET /identity/v3/role_assignments?user.id=3170dcaf527b44b8bd33cae78b39fb2f&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=a25a64439bdc4250924866297524814c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:19.776276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eca64a-0ea0-4066-b1cf-626e645c7327 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:19.776809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eca64a-0ea0-4066-b1cf-626e645c7327 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:19.776809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eca64a-0ea0-4066-b1cf-626e645c7327 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:19.778309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 499/990] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:19.784071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc8e23-d797-4e10-b301-c0d4a42f6690 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:19.784586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc8e23-d797-4e10-b301-c0d4a42f6690 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:19.784661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc8e23-d797-4e10-b301-c0d4a42f6690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:19.792452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:19.805568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-dacc8e23-d797-4e10-b301-c0d4a42f6690 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:19.807279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dacc8e23-d797-4e10-b301-c0d4a42f6690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:19.878788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 492/991] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:19.898781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eca64a-0ea0-4066-b1cf-626e645c7327 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:19.958188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:19.980638 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34833404-8776-44be-aaa0-6dd6bbc471f3 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:19.980942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34833404-8776-44be-aaa0-6dd6bbc471f3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:19.981210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34833404-8776-44be-aaa0-6dd6bbc471f3 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:19.982727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 493/992] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:55:19.987424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b75d6-20d7-42db-9c3b-8eb5b4b66c11 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:19.987716 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b75d6-20d7-42db-9c3b-8eb5b4b66c11 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:19.987993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b75d6-20d7-42db-9c3b-8eb5b4b66c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:20.006249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1b4b75d6-20d7-42db-9c3b-8eb5b4b66c11 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:20.006456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eca64a-0ea0-4066-b1cf-626e645c7327 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:20.007480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1b4b75d6-20d7-42db-9c3b-8eb5b4b66c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:20.042316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28250204-996f-4307-a195-096077b8d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:20.043118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28250204-996f-4307-a195-096077b8d160 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:20.043488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28250204-996f-4307-a195-096077b8d160 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:20.043763 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28250204-996f-4307-a195-096077b8d160 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:20.045207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28250204-996f-4307-a195-096077b8d160 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:20.046575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28250204-996f-4307-a195-096077b8d160 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-28250204-996f-4307-a195-096077b8d160 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:20.059566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:20.060632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:20.061511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 500/993] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:20.068596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28250204-996f-4307-a195-096077b8d160 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:20.088258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 494/994] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:20.118042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b75d6-20d7-42db-9c3b-8eb5b4b66c11 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:20.176081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28250204-996f-4307-a195-096077b8d160 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:20.192534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:20.194802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:20.217288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aee776-2146-4388-9fca-9ceb3454c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:20.218281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aee776-2146-4388-9fca-9ceb3454c232 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:20.218793 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aee776-2146-4388-9fca-9ceb3454c232 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:20.219268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aee776-2146-4388-9fca-9ceb3454c232 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:20.220189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aee776-2146-4388-9fca-9ceb3454c232 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:20.220701 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aee776-2146-4388-9fca-9ceb3454c232 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:20.222266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aee776-2146-4388-9fca-9ceb3454c232 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:20.227961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 501/995] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:55:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:20.233629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aee776-2146-4388-9fca-9ceb3454c232 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:20.233755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b75d6-20d7-42db-9c3b-8eb5b4b66c11 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:20.270191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15d85-3cd1-4be4-886c-a962e3286784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:20.271352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15d85-3cd1-4be4-886c-a962e3286784 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:20.271833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15d85-3cd1-4be4-886c-a962e3286784 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:20.272302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15d85-3cd1-4be4-886c-a962e3286784 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:20.273352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa15d85-3cd1-4be4-886c-a962e3286784 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:20.275263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa15d85-3cd1-4be4-886c-a962e3286784 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-baa15d85-3cd1-4be4-886c-a962e3286784 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:20.288080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:20.289990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 17:55:20.291058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:20.293333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 495/996] 10.222.0.30 () {56 vars in 1126 bytes} [Mon May 23 17:55:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:20.300159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15d85-3cd1-4be4-886c-a962e3286784 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:20.346573 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aee776-2146-4388-9fca-9ceb3454c232 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:20.432633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f439c-77e2-4062-a60e-c1c313d4136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:20.433739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f439c-77e2-4062-a60e-c1c313d4136f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:20.434075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f439c-77e2-4062-a60e-c1c313d4136f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:20.434355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f439c-77e2-4062-a60e-c1c313d4136f None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:20.435151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f439c-77e2-4062-a60e-c1c313d4136f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:20.435459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f439c-77e2-4062-a60e-c1c313d4136f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:20.436861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f439c-77e2-4062-a60e-c1c313d4136f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:20.449177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 502/997] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:55:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:20.451378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f439c-77e2-4062-a60e-c1c313d4136f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:20.456551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15d85-3cd1-4be4-886c-a962e3286784 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:20.488416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:20.498179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254bf6e-4d3f-4406-8dd1-5914f4dfc803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:20.498892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254bf6e-4d3f-4406-8dd1-5914f4dfc803 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:20.499178 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254bf6e-4d3f-4406-8dd1-5914f4dfc803 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:20.499455 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254bf6e-4d3f-4406-8dd1-5914f4dfc803 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:20.500401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254bf6e-4d3f-4406-8dd1-5914f4dfc803 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:20.500509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254bf6e-4d3f-4406-8dd1-5914f4dfc803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:20.501822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254bf6e-4d3f-4406-8dd1-5914f4dfc803 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:20.511805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 496/998] 10.222.0.30 () {56 vars in 1122 bytes} [Mon May 23 17:55:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:20.511965 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:20.514954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254bf6e-4d3f-4406-8dd1-5914f4dfc803 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:20.571043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f439c-77e2-4062-a60e-c1c313d4136f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:20.606561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabfaeb-be5d-41fd-b858-b7d83670f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:20.607267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabfaeb-be5d-41fd-b858-b7d83670f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:20.607551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabfaeb-be5d-41fd-b858-b7d83670f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:20.607829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabfaeb-be5d-41fd-b858-b7d83670f6f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:20.608619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabfaeb-be5d-41fd-b858-b7d83670f6f0 None admin] RBAC: Adding query filter params (interface=public, service_id=83f6390238fd4c68a46a09f11d7c61d3, region_id=RegionOne) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:20.608935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabfaeb-be5d-41fd-b858-b7d83670f6f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:20.610337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabfaeb-be5d-41fd-b858-b7d83670f6f0 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:20.615598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 503/999] 10.222.0.30 () {56 vars in 1251 bytes} [Mon May 23 17:55:20 2022] GET /identity/v3/endpoints?service_id=83f6390238fd4c68a46a09f11d7c61d3&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:20.621758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabfaeb-be5d-41fd-b858-b7d83670f6f0 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:20.633640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254bf6e-4d3f-4406-8dd1-5914f4dfc803 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:20.672184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1758-3ce1-4619-860b-0976c4270aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:20.672852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1758-3ce1-4619-860b-0976c4270aed None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:20.673308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1758-3ce1-4619-860b-0976c4270aed None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:20.673589 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1758-3ce1-4619-860b-0976c4270aed None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:20.674681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f1758-3ce1-4619-860b-0976c4270aed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:20.675176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f1758-3ce1-4619-860b-0976c4270aed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:20.676553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f1758-3ce1-4619-860b-0976c4270aed None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:20.682431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 497/1000] 10.222.0.30 () {56 vars in 1122 bytes} [Mon May 23 17:55:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:20.687829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1758-3ce1-4619-860b-0976c4270aed None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:20.734111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabfaeb-be5d-41fd-b858-b7d83670f6f0 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:20.745699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:20.747304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:20.773324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64afa5e-586f-417b-948a-da396bfc7ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:20.773989 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afa5e-586f-417b-948a-da396bfc7ffe None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:20.774281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afa5e-586f-417b-948a-da396bfc7ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:20.774548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afa5e-586f-417b-948a-da396bfc7ffe None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:20.775258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64afa5e-586f-417b-948a-da396bfc7ffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:20.776621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64afa5e-586f-417b-948a-da396bfc7ffe None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:20.783360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 504/1001] 10.222.0.30 () {56 vars in 1087 bytes} [Mon May 23 17:55:20 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 17:55:20.799304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1758-3ce1-4619-860b-0976c4270aed None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:20.838345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00081968-015d-43a0-8d99-75426ad14bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:20.838971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00081968-015d-43a0-8d99-75426ad14bf8 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:20.839258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00081968-015d-43a0-8d99-75426ad14bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:20.839533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00081968-015d-43a0-8d99-75426ad14bf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:20.840288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00081968-015d-43a0-8d99-75426ad14bf8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:20.841703 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00081968-015d-43a0-8d99-75426ad14bf8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:20.864958 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 498/1002] 10.222.0.30 () {60 vars in 1144 bytes} [Mon May 23 17:55:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:55:21.071228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf6067-fd68-44cf-a325-05ea7e4828c8 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:21.071547 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf6067-fd68-44cf-a325-05ea7e4828c8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:21.071789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf6067-fd68-44cf-a325-05ea7e4828c8 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:21.073305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 505/1003] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:21.078630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a189b6e-1ebc-489b-8697-8a009baa66f7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:21.078957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a189b6e-1ebc-489b-8697-8a009baa66f7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:21.079239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a189b6e-1ebc-489b-8697-8a009baa66f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:21.097675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4a189b6e-1ebc-489b-8697-8a009baa66f7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:21.099161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4a189b6e-1ebc-489b-8697-8a009baa66f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:21.175575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 499/1004] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:21.197822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf6067-fd68-44cf-a325-05ea7e4828c8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:21.302771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf6067-fd68-44cf-a325-05ea7e4828c8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:21.338615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1437efa-111e-4087-bd8c-c25c2cd8a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:21.339792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1437efa-111e-4087-bd8c-c25c2cd8a3ca None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:21.340262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1437efa-111e-4087-bd8c-c25c2cd8a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:21.340775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1437efa-111e-4087-bd8c-c25c2cd8a3ca None admin] PATH_INFO: `/v3/services/image` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:21.341606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1437efa-111e-4087-bd8c-c25c2cd8a3ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:21.343275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1437efa-111e-4087-bd8c-c25c2cd8a3ca None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-a1437efa-111e-4087-bd8c-c25c2cd8a3ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:21.355640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:21.356792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:55:21.357668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:21.358413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 506/1005] 10.222.0.30 () {56 vars in 1105 bytes} [Mon May 23 17:55:21 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:21.364426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a189b6e-1ebc-489b-8697-8a009baa66f7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:21.411682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:21.476745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a189b6e-1ebc-489b-8697-8a009baa66f7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:21.521563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99761c0-9dcf-40b7-80c0-376ba7e3a4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:21.522240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99761c0-9dcf-40b7-80c0-376ba7e3a4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:21.522523 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99761c0-9dcf-40b7-80c0-376ba7e3a4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:21.522819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99761c0-9dcf-40b7-80c0-376ba7e3a4c5 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:21.524031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99761c0-9dcf-40b7-80c0-376ba7e3a4c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:21.524344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99761c0-9dcf-40b7-80c0-376ba7e3a4c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:21.525723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99761c0-9dcf-40b7-80c0-376ba7e3a4c5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:21.531191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 500/1006] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:21.536579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1437efa-111e-4087-bd8c-c25c2cd8a3ca None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:21.578066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:21.642015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1437efa-111e-4087-bd8c-c25c2cd8a3ca None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:21.676003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5af210-716b-49ee-92cd-94d1da6cf2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:21.676667 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5af210-716b-49ee-92cd-94d1da6cf2fe None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:21.676948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5af210-716b-49ee-92cd-94d1da6cf2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:21.677225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5af210-716b-49ee-92cd-94d1da6cf2fe None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:21.677924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5af210-716b-49ee-92cd-94d1da6cf2fe None admin] RBAC: Adding query filter params (type=image) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:21.678231 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5af210-716b-49ee-92cd-94d1da6cf2fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:21.679749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5af210-716b-49ee-92cd-94d1da6cf2fe None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:21.684513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 507/1007] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:23.017452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d718-9c54-4e77-8998-8a18fd8f3571 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.017972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d718-9c54-4e77-8998-8a18fd8f3571 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.017972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d718-9c54-4e77-8998-8a18fd8f3571 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.019419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 501/1008] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:23.025262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf0170-8032-431d-bb05-4541904fe6cf None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.025646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf0170-8032-431d-bb05-4541904fe6cf None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.025838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf0170-8032-431d-bb05-4541904fe6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.042614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f8cf0170-8032-431d-bb05-4541904fe6cf None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:23.043807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f8cf0170-8032-431d-bb05-4541904fe6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:23.109120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6577c-cb36-4e9c-93ca-fdab470e7603 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.109427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6577c-cb36-4e9c-93ca-fdab470e7603 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.109668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6577c-cb36-4e9c-93ca-fdab470e7603 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.110373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 508/1009] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:23 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:23.111167 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 502/1010] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:55:23.117407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60ca9e-191e-4524-9eb3-1abefefb3d15 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.117897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60ca9e-191e-4524-9eb3-1abefefb3d15 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.118369 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60ca9e-191e-4524-9eb3-1abefefb3d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.135253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6577c-cb36-4e9c-93ca-fdab470e7603 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:23.138267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9a60ca9e-191e-4524-9eb3-1abefefb3d15 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:23.139471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9a60ca9e-191e-4524-9eb3-1abefefb3d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:23.168175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:23.218394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 509/1011] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:23 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:23.240448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60ca9e-191e-4524-9eb3-1abefefb3d15 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:23.246020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6577c-cb36-4e9c-93ca-fdab470e7603 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:23.253591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:23.283014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255006e5-1953-4725-9ebc-d52832aa44c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:23.284055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255006e5-1953-4725-9ebc-d52832aa44c2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.284055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255006e5-1953-4725-9ebc-d52832aa44c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.284266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255006e5-1953-4725-9ebc-d52832aa44c2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.285062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255006e5-1953-4725-9ebc-d52832aa44c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:23.286526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255006e5-1953-4725-9ebc-d52832aa44c2 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-255006e5-1953-4725-9ebc-d52832aa44c2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:23.299545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:23.300739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:23.301594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 503/1012] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:23.307302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255006e5-1953-4725-9ebc-d52832aa44c2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:23.353743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60ca9e-191e-4524-9eb3-1abefefb3d15 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:23.392904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc885-815d-4a20-aace-ff52c5df0788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:23.393803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc885-815d-4a20-aace-ff52c5df0788 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.394082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc885-815d-4a20-aace-ff52c5df0788 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.394355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc885-815d-4a20-aace-ff52c5df0788 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.395682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc885-815d-4a20-aace-ff52c5df0788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:23.397207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc885-815d-4a20-aace-ff52c5df0788 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:23.404463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 510/1013] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:23.405121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc885-815d-4a20-aace-ff52c5df0788 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:23.419242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255006e5-1953-4725-9ebc-d52832aa44c2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:23.437995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:23.455242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b2005-a07e-48b6-ad39-929849a9e550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:23.455906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2005-a07e-48b6-ad39-929849a9e550 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.456189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2005-a07e-48b6-ad39-929849a9e550 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.456460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2005-a07e-48b6-ad39-929849a9e550 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.457164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b2005-a07e-48b6-ad39-929849a9e550 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:23.457465 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b2005-a07e-48b6-ad39-929849a9e550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:23.458854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b2005-a07e-48b6-ad39-929849a9e550 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:23.464766 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 504/1014] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:55:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:23.470533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b2005-a07e-48b6-ad39-929849a9e550 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:23.514864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:23.522424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc885-815d-4a20-aace-ff52c5df0788 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:23.558670 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036066a6-623e-41bc-bbaf-09eaa65d021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:23.559279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036066a6-623e-41bc-bbaf-09eaa65d021b None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.559563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036066a6-623e-41bc-bbaf-09eaa65d021b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.559840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036066a6-623e-41bc-bbaf-09eaa65d021b None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.560548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036066a6-623e-41bc-bbaf-09eaa65d021b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:23.561971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036066a6-623e-41bc-bbaf-09eaa65d021b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:23.587814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 511/1015] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:55:23 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:55:23.597936 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b2005-a07e-48b6-ad39-929849a9e550 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:23.638873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0494a2-eeef-4b98-aacb-94a59990f40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:23.639558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0494a2-eeef-4b98-aacb-94a59990f40d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.639839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0494a2-eeef-4b98-aacb-94a59990f40d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.640113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0494a2-eeef-4b98-aacb-94a59990f40d None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.640830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0494a2-eeef-4b98-aacb-94a59990f40d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:23.641135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0494a2-eeef-4b98-aacb-94a59990f40d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:23.642556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0494a2-eeef-4b98-aacb-94a59990f40d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:23.653688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 505/1016] 10.222.0.30 () {56 vars in 1112 bytes} [Mon May 23 17:55:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:23.654532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036066a6-623e-41bc-bbaf-09eaa65d021b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:23.750211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:23.772689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036066a6-623e-41bc-bbaf-09eaa65d021b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:23.814204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9810bcd-cd17-4092-868b-9a71fa9f9b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:23.814822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9810bcd-cd17-4092-868b-9a71fa9f9b5f None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.815106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9810bcd-cd17-4092-868b-9a71fa9f9b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.815379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9810bcd-cd17-4092-868b-9a71fa9f9b5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.816123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9810bcd-cd17-4092-868b-9a71fa9f9b5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:23.817470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9810bcd-cd17-4092-868b-9a71fa9f9b5f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:23.837099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 512/1017] 10.222.0.30 () {60 vars in 1144 bytes} [Mon May 23 17:55:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:55:23.919333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301110f-cd9f-4bd9-9286-709441f036bf None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.919621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301110f-cd9f-4bd9-9286-709441f036bf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.919904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301110f-cd9f-4bd9-9286-709441f036bf None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.921313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 506/1018] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:23.927397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb0b10-c3b8-4a8b-b6e7-c4cc2db5f85c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:23.927824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb0b10-c3b8-4a8b-b6e7-c4cc2db5f85c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:23.928298 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb0b10-c3b8-4a8b-b6e7-c4cc2db5f85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:23.946959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-13cb0b10-c3b8-4a8b-b6e7-c4cc2db5f85c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:23.948187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-13cb0b10-c3b8-4a8b-b6e7-c4cc2db5f85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:24.030530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 513/1019] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:24.053146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301110f-cd9f-4bd9-9286-709441f036bf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:24.159507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:24.165310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301110f-cd9f-4bd9-9286-709441f036bf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:24.200253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537184fa-f1f5-45d7-bb5f-6d1804617599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:24.201016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537184fa-f1f5-45d7-bb5f-6d1804617599 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:24.201316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537184fa-f1f5-45d7-bb5f-6d1804617599 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:24.201658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537184fa-f1f5-45d7-bb5f-6d1804617599 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:24.202377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537184fa-f1f5-45d7-bb5f-6d1804617599 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:24.203835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537184fa-f1f5-45d7-bb5f-6d1804617599 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:24.219136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 507/1020] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:55:24 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:55:25.895999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f341-1148-47e5-8916-a88771b43fce None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:25.896508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f341-1148-47e5-8916-a88771b43fce None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:25.896588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871f341-1148-47e5-8916-a88771b43fce None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:25.898644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 514/1021] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:25.903803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90df96-96e5-473d-8dbe-8f406f331582 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:25.904212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90df96-96e5-473d-8dbe-8f406f331582 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:25.904394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90df96-96e5-473d-8dbe-8f406f331582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:25.921865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6e90df96-96e5-473d-8dbe-8f406f331582 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:25.923070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6e90df96-96e5-473d-8dbe-8f406f331582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:25.998630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 508/1022] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:26.024368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871f341-1148-47e5-8916-a88771b43fce None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:26.088791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:26.129662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871f341-1148-47e5-8916-a88771b43fce None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:26.164554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee583a02-8efe-4c50-9f2d-6228cece5edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:26.165308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583a02-8efe-4c50-9f2d-6228cece5edd None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.165595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583a02-8efe-4c50-9f2d-6228cece5edd None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.165872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583a02-8efe-4c50-9f2d-6228cece5edd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.167076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee583a02-8efe-4c50-9f2d-6228cece5edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:26.168527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee583a02-8efe-4c50-9f2d-6228cece5edd None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:26.170160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 515/1023] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:26.175861 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90df96-96e5-473d-8dbe-8f406f331582 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:26.178738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d080fa-9a8a-4253-9010-9a603ee36b7c None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.179109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d080fa-9a8a-4253-9010-9a603ee36b7c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.179888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d080fa-9a8a-4253-9010-9a603ee36b7c None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.181222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 516/1024] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:55:26.186239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a563a-03cf-4662-a76a-b04f2ea50432 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.186527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a563a-03cf-4662-a76a-b04f2ea50432 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.186836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a563a-03cf-4662-a76a-b04f2ea50432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.204140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ca2a563a-03cf-4662-a76a-b04f2ea50432 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:26.205331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ca2a563a-03cf-4662-a76a-b04f2ea50432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:26.268094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:26.294439 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 517/1025] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:26.294663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90df96-96e5-473d-8dbe-8f406f331582 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:26.312562 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a563a-03cf-4662-a76a-b04f2ea50432 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:26.328104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0848be7-b9b9-41b7-8ee2-660f6bcde561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:26.328779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0848be7-b9b9-41b7-8ee2-660f6bcde561 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.329059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0848be7-b9b9-41b7-8ee2-660f6bcde561 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.329331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0848be7-b9b9-41b7-8ee2-660f6bcde561 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.330051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0848be7-b9b9-41b7-8ee2-660f6bcde561 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:26.331500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0848be7-b9b9-41b7-8ee2-660f6bcde561 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:26.354750 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 509/1026] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:55:26 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:55:26.391207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:26.437181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a563a-03cf-4662-a76a-b04f2ea50432 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:26.475657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5da70d-021e-4cdf-8d04-399ce9b21e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:26.477039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da70d-021e-4cdf-8d04-399ce9b21e5d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.477323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da70d-021e-4cdf-8d04-399ce9b21e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.477601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da70d-021e-4cdf-8d04-399ce9b21e5d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.478261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a32dc-e776-4d50-baa9-702383391441 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.478557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a32dc-e776-4d50-baa9-702383391441 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.478883 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a32dc-e776-4d50-baa9-702383391441 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.480272 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 510/1027] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:55:26.486112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752e03a-1efd-4b8e-a67a-cded95c38231 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.486494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752e03a-1efd-4b8e-a67a-cded95c38231 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.486914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752e03a-1efd-4b8e-a67a-cded95c38231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.490453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5da70d-021e-4cdf-8d04-399ce9b21e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-fc5da70d-021e-4cdf-8d04-399ce9b21e5d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:26.499642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:26.500715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:26.506833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 518/1028] 10.222.0.30 () {56 vars in 1120 bytes} [Mon May 23 17:55:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:26.508430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b752e03a-1efd-4b8e-a67a-cded95c38231 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:26.508430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b752e03a-1efd-4b8e-a67a-cded95c38231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:26.508578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5da70d-021e-4cdf-8d04-399ce9b21e5d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:26.594855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 511/1029] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:26.619097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752e03a-1efd-4b8e-a67a-cded95c38231 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:26.628248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5da70d-021e-4cdf-8d04-399ce9b21e5d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:26.653355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:26.667213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846c58f-7014-49ed-a677-ff343e56b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:26.667888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c58f-7014-49ed-a677-ff343e56b874 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.668171 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c58f-7014-49ed-a677-ff343e56b874 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.668449 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c58f-7014-49ed-a677-ff343e56b874 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.669192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846c58f-7014-49ed-a677-ff343e56b874 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:26.669496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846c58f-7014-49ed-a677-ff343e56b874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:26.670880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846c58f-7014-49ed-a677-ff343e56b874 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:26.679561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 519/1030] 10.222.0.30 () {56 vars in 1115 bytes} [Mon May 23 17:55:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:26.685407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846c58f-7014-49ed-a677-ff343e56b874 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:26.697423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:26.738534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752e03a-1efd-4b8e-a67a-cded95c38231 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:26.775172 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc11f-7d90-4d5b-a242-aab32c8ca1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:26.775971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc11f-7d90-4d5b-a242-aab32c8ca1be None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.776250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc11f-7d90-4d5b-a242-aab32c8ca1be None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.776524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc11f-7d90-4d5b-a242-aab32c8ca1be None admin] PATH_INFO: `/v3/services/image` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.777172 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cc11f-7d90-4d5b-a242-aab32c8ca1be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:26.778540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cc11f-7d90-4d5b-a242-aab32c8ca1be None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-d72cc11f-7d90-4d5b-a242-aab32c8ca1be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:26.790993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:26.792239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:26.793124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 512/1031] 10.222.0.30 () {56 vars in 1105 bytes} [Mon May 23 17:55:26 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:26.795823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846c58f-7014-49ed-a677-ff343e56b874 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:26.798922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc11f-7d90-4d5b-a242-aab32c8ca1be None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:26.833237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a05f-756d-4763-8815-173fefeb7333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:26.834031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a05f-756d-4763-8815-173fefeb7333 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.834314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a05f-756d-4763-8815-173fefeb7333 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.834584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a05f-756d-4763-8815-173fefeb7333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.846074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a05f-756d-4763-8815-173fefeb7333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:26.847539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a05f-756d-4763-8815-173fefeb7333 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-03a6a05f-756d-4763-8815-173fefeb7333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:26.865325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:26.866277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:26.872745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:26.872745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:26.872745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:26.872745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:26.872745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 520/1032] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:26.873102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a05f-756d-4763-8815-173fefeb7333 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:26.908514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:26.909137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc11f-7d90-4d5b-a242-aab32c8ca1be None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:26.949446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78355e6c-849b-41fe-9fe6-95ae4ab48630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:26.950032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78355e6c-849b-41fe-9fe6-95ae4ab48630 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:26.950315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78355e6c-849b-41fe-9fe6-95ae4ab48630 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:26.950588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78355e6c-849b-41fe-9fe6-95ae4ab48630 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:26.951324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78355e6c-849b-41fe-9fe6-95ae4ab48630 None admin] RBAC: Adding query filter params (name=image) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:26.951627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78355e6c-849b-41fe-9fe6-95ae4ab48630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:26.953435 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78355e6c-849b-41fe-9fe6-95ae4ab48630 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:26.954722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:26.964882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 513/1033] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:26.965797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78355e6c-849b-41fe-9fe6-95ae4ab48630 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:26.980481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a05f-756d-4763-8815-173fefeb7333 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:27.015433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f814559-67f8-4eb4-ab85-b08e061a9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:27.016092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f814559-67f8-4eb4-ab85-b08e061a9049 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:27.016372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f814559-67f8-4eb4-ab85-b08e061a9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:27.016652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f814559-67f8-4eb4-ab85-b08e061a9049 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:27.017369 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f814559-67f8-4eb4-ab85-b08e061a9049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:27.017679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f814559-67f8-4eb4-ab85-b08e061a9049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:27.019077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f814559-67f8-4eb4-ab85-b08e061a9049 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:27.032731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 521/1034] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:27.037868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f814559-67f8-4eb4-ab85-b08e061a9049 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:27.074169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78355e6c-849b-41fe-9fe6-95ae4ab48630 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:27.108947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47ef06-0f79-4573-a5a5-7e534157f664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:27.109610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47ef06-0f79-4573-a5a5-7e534157f664 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:27.109887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47ef06-0f79-4573-a5a5-7e534157f664 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:27.110157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47ef06-0f79-4573-a5a5-7e534157f664 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:27.110892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47ef06-0f79-4573-a5a5-7e534157f664 None admin] RBAC: Adding query filter params (type=image) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:27.111196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47ef06-0f79-4573-a5a5-7e534157f664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:27.112557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47ef06-0f79-4573-a5a5-7e534157f664 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:27.122425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 514/1035] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:27.123631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47ef06-0f79-4573-a5a5-7e534157f664 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:27.142322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:27.149169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f814559-67f8-4eb4-ab85-b08e061a9049 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:27.185174 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3988c52-514a-4442-bac3-88143047f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:27.185960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988c52-514a-4442-bac3-88143047f731 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:27.186245 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988c52-514a-4442-bac3-88143047f731 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:27.186519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988c52-514a-4442-bac3-88143047f731 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:27.190715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:27.195214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3988c52-514a-4442-bac3-88143047f731 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:27.196744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3988c52-514a-4442-bac3-88143047f731 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-a3988c52-514a-4442-bac3-88143047f731 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:55:27.213097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:27.214177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:27.215807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 522/1036] 10.222.0.30 () {56 vars in 1093 bytes} [Mon May 23 17:55:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:27.219923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3988c52-514a-4442-bac3-88143047f731 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:27.241999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47ef06-0f79-4573-a5a5-7e534157f664 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:27.277738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6ff19-be8e-48ef-b8e1-070a2c0a3ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:27.278503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6ff19-be8e-48ef-b8e1-070a2c0a3ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:27.278841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6ff19-be8e-48ef-b8e1-070a2c0a3ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:27.279201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6ff19-be8e-48ef-b8e1-070a2c0a3ad6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:27.280047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6ff19-be8e-48ef-b8e1-070a2c0a3ad6 None admin] RBAC: Adding query filter params (interface=public, service_id=a6337ec6b6f84a1188ec9b50629fac49, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:27.280357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6ff19-be8e-48ef-b8e1-070a2c0a3ad6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:27.281881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6ff19-be8e-48ef-b8e1-070a2c0a3ad6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:27.291736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 515/1037] 10.222.0.30 () {56 vars in 1251 bytes} [Mon May 23 17:55:27 2022] GET /identity/v3/endpoints?service_id=a6337ec6b6f84a1188ec9b50629fac49&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:27.292756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6ff19-be8e-48ef-b8e1-070a2c0a3ad6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:27.328568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3988c52-514a-4442-bac3-88143047f731 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:27.366203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e560eb-c833-418c-aeb7-a894ac2f346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:27.367142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e560eb-c833-418c-aeb7-a894ac2f346b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:27.367424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e560eb-c833-418c-aeb7-a894ac2f346b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:27.367865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e560eb-c833-418c-aeb7-a894ac2f346b None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:27.369450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e560eb-c833-418c-aeb7-a894ac2f346b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:27.369765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e560eb-c833-418c-aeb7-a894ac2f346b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:27.371219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e560eb-c833-418c-aeb7-a894ac2f346b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:27.398761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 523/1038] 10.222.0.30 () {56 vars in 1133 bytes} [Mon May 23 17:55:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:27.400016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e560eb-c833-418c-aeb7-a894ac2f346b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:27.400403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6ff19-be8e-48ef-b8e1-070a2c0a3ad6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:27.420483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:27.427667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:27.437941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5696f3-44b6-481c-9621-d1b8b6c7047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:27.438600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5696f3-44b6-481c-9621-d1b8b6c7047b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:27.439039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5696f3-44b6-481c-9621-d1b8b6c7047b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:27.439319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5696f3-44b6-481c-9621-d1b8b6c7047b None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:27.440007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5696f3-44b6-481c-9621-d1b8b6c7047b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:27.441380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5696f3-44b6-481c-9621-d1b8b6c7047b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:27.458737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 516/1039] 10.222.0.30 () {56 vars in 1087 bytes} [Mon May 23 17:55:27 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:55:27.536167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e560eb-c833-418c-aeb7-a894ac2f346b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:27.575771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c0fa9-cb26-42be-836b-f1eb01f05bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:27.576436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c0fa9-cb26-42be-836b-f1eb01f05bed None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:27.576720 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c0fa9-cb26-42be-836b-f1eb01f05bed None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:27.577001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c0fa9-cb26-42be-836b-f1eb01f05bed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:27.654037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c0fa9-cb26-42be-836b-f1eb01f05bed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:27.655515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c0fa9-cb26-42be-836b-f1eb01f05bed None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:27.675627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:27.760844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 524/1040] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 17:55:27.766778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5696f3-44b6-481c-9621-d1b8b6c7047b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:27.871844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5696f3-44b6-481c-9621-d1b8b6c7047b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:27.905993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3349a04-9539-4282-a8b7-86ce73c74913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:27.906891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3349a04-9539-4282-a8b7-86ce73c74913 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:27.907180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3349a04-9539-4282-a8b7-86ce73c74913 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:27.907458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3349a04-9539-4282-a8b7-86ce73c74913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:27.918459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3349a04-9539-4282-a8b7-86ce73c74913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:27.919994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3349a04-9539-4282-a8b7-86ce73c74913 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-d3349a04-9539-4282-a8b7-86ce73c74913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:27.937189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:27.938114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:27.939400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:27.939400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:27.939400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:27.939400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:27.939400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 517/1041] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:27.944092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c0fa9-cb26-42be-836b-f1eb01f05bed None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:28.047383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c0fa9-cb26-42be-836b-f1eb01f05bed None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:28.063277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:28.084713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455b273-9f7f-4cf6-8f42-eb6a802d48a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:28.085469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455b273-9f7f-4cf6-8f42-eb6a802d48a1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:28.085747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455b273-9f7f-4cf6-8f42-eb6a802d48a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:28.086023 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455b273-9f7f-4cf6-8f42-eb6a802d48a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:28.086752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455b273-9f7f-4cf6-8f42-eb6a802d48a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:28.087059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455b273-9f7f-4cf6-8f42-eb6a802d48a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:28.088426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455b273-9f7f-4cf6-8f42-eb6a802d48a1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:28.104470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 525/1042] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:28.106040 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3349a04-9539-4282-a8b7-86ce73c74913 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:28.153207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:28.213318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3349a04-9539-4282-a8b7-86ce73c74913 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:28.247984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7119651-64b4-4795-98e1-938174514f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:28.248791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119651-64b4-4795-98e1-938174514f9c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:28.249078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119651-64b4-4795-98e1-938174514f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:28.249353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7119651-64b4-4795-98e1-938174514f9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:28.256129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7119651-64b4-4795-98e1-938174514f9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:28.258124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7119651-64b4-4795-98e1-938174514f9c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-b7119651-64b4-4795-98e1-938174514f9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:55:28.273124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:28.274149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:28.275548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:55:28.275548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:55:28.275548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:55:28.275548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:55:28.275548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:55:28.275548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:55:28.275548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:28.275548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:28.279429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 518/1043] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:28.280843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455b273-9f7f-4cf6-8f42-eb6a802d48a1 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:28.384880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455b273-9f7f-4cf6-8f42-eb6a802d48a1 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:28.421106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57860a65-ce30-450f-8514-ca8cec01f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:28.421685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57860a65-ce30-450f-8514-ca8cec01f501 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:28.421974 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57860a65-ce30-450f-8514-ca8cec01f501 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:28.422252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57860a65-ce30-450f-8514-ca8cec01f501 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:28.423059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57860a65-ce30-450f-8514-ca8cec01f501 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:28.423370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57860a65-ce30-450f-8514-ca8cec01f501 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:28.424789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57860a65-ce30-450f-8514-ca8cec01f501 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:28.442041 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 526/1044] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:55:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:28.443615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7119651-64b4-4795-98e1-938174514f9c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:28.568871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7119651-64b4-4795-98e1-938174514f9c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:28.570593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:28.608391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35135a-3813-4086-bdc7-0308deb1b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:28.609057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35135a-3813-4086-bdc7-0308deb1b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:28.609342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35135a-3813-4086-bdc7-0308deb1b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:28.609621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35135a-3813-4086-bdc7-0308deb1b2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:28.610457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35135a-3813-4086-bdc7-0308deb1b2c8 None admin] RBAC: Adding query filter params (role.id=a25a64439bdc4250924866297524814c, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=9021e2249e11489083139e210562ce44) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:28.610800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35135a-3813-4086-bdc7-0308deb1b2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:28.612244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35135a-3813-4086-bdc7-0308deb1b2c8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:28.618965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 519/1045] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:28 2022] GET /identity/v3/role_assignments?user.id=9021e2249e11489083139e210562ce44&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=a25a64439bdc4250924866297524814c => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:28.661003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9ccea-1a3d-41c4-b5cc-091d491d5ce6 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:28.661343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9ccea-1a3d-41c4-b5cc-091d491d5ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:28.661563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9ccea-1a3d-41c4-b5cc-091d491d5ce6 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:28.663172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 527/1046] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:28.669677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d4c7-0b55-4099-ba23-8b43cb5daac9 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:28.669953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d4c7-0b55-4099-ba23-8b43cb5daac9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:28.670233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d4c7-0b55-4099-ba23-8b43cb5daac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:28.689180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8853d4c7-0b55-4099-ba23-8b43cb5daac9 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:28.690297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8853d4c7-0b55-4099-ba23-8b43cb5daac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:28.765317 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 520/1047] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:28.790254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9ccea-1a3d-41c4-b5cc-091d491d5ce6 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:28.828186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:28.908541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9ccea-1a3d-41c4-b5cc-091d491d5ce6 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:28.950429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55b77c-fa39-4f26-bf08-2143649374ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:28.951219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b77c-fa39-4f26-bf08-2143649374ef None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:28.951442 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b77c-fa39-4f26-bf08-2143649374ef None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:28.951712 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b77c-fa39-4f26-bf08-2143649374ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:28.962677 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55b77c-fa39-4f26-bf08-2143649374ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-ab55b77c-fa39-4f26-bf08-2143649374ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:28.970347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:28.971472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:28.972346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 528/1048] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:55:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:28.980084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d4c7-0b55-4099-ba23-8b43cb5daac9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:29.074649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:29.081486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d4c7-0b55-4099-ba23-8b43cb5daac9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:29.117359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32830fb2-b251-43a3-b0f8-f20d3f6dc23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:29.118033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32830fb2-b251-43a3-b0f8-f20d3f6dc23f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:29.118314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32830fb2-b251-43a3-b0f8-f20d3f6dc23f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:29.118586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32830fb2-b251-43a3-b0f8-f20d3f6dc23f None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:29.119361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32830fb2-b251-43a3-b0f8-f20d3f6dc23f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:29.119665 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32830fb2-b251-43a3-b0f8-f20d3f6dc23f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:29.121037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32830fb2-b251-43a3-b0f8-f20d3f6dc23f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:29.134741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 521/1049] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:55:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:29.136611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55b77c-fa39-4f26-bf08-2143649374ef None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:29.237257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:29.246053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55b77c-fa39-4f26-bf08-2143649374ef None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:29.279673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d4655-2870-4e1f-9c25-9d6c0fb4ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:29.280541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d4655-2870-4e1f-9c25-9d6c0fb4ea9a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:29.280821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d4655-2870-4e1f-9c25-9d6c0fb4ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:29.281093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d4655-2870-4e1f-9c25-9d6c0fb4ea9a None admin] PATH_INFO: `/v3/users/7041713f420a44a5813381a72667264b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:29.296352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d4655-2870-4e1f-9c25-9d6c0fb4ea9a None admin] RBAC: Authorizing `identity:get_user(user_id=7041713f420a44a5813381a72667264b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:29.297791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d4655-2870-4e1f-9c25-9d6c0fb4ea9a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:29.304127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 529/1050] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:29 2022] GET /identity/v3/users/7041713f420a44a5813381a72667264b => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:29.305503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32830fb2-b251-43a3-b0f8-f20d3f6dc23f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:29.406976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32830fb2-b251-43a3-b0f8-f20d3f6dc23f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:29.440477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e6b9c-9ab7-4dad-ae5e-cb754a475929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:29.441114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e6b9c-9ab7-4dad-ae5e-cb754a475929 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:29.441394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e6b9c-9ab7-4dad-ae5e-cb754a475929 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:29.441665 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e6b9c-9ab7-4dad-ae5e-cb754a475929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:29.469175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:29.524354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e6b9c-9ab7-4dad-ae5e-cb754a475929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:29.525803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e6b9c-9ab7-4dad-ae5e-cb754a475929 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:29.631488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 522/1051] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:55:29.633144 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d4655-2870-4e1f-9c25-9d6c0fb4ea9a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:29.698691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00f3ae-926f-4819-87ea-49f97b299fef None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:29.699055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00f3ae-926f-4819-87ea-49f97b299fef None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:29.699280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00f3ae-926f-4819-87ea-49f97b299fef None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:29.700782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 523/1052] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:55:29.706732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e8749-3ef8-4dd0-90ce-59b202e9c776 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:29.706732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e8749-3ef8-4dd0-90ce-59b202e9c776 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:29.706732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e8749-3ef8-4dd0-90ce-59b202e9c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:29.725278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e79e8749-3ef8-4dd0-90ce-59b202e9c776 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:29.726812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e79e8749-3ef8-4dd0-90ce-59b202e9c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:29.735462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d4655-2870-4e1f-9c25-9d6c0fb4ea9a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:29.774645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c8fad-bcb1-4c7b-89f8-8c80f44bf458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:29.775457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c8fad-bcb1-4c7b-89f8-8c80f44bf458 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:29.775742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c8fad-bcb1-4c7b-89f8-8c80f44bf458 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:29.776019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c8fad-bcb1-4c7b-89f8-8c80f44bf458 None admin] PATH_INFO: `/v3/projects/568ecd6d78604253958a9d0136bab9fb` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:29.777201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c8fad-bcb1-4c7b-89f8-8c80f44bf458 None admin] RBAC: Authorizing `identity:get_project(project_id=568ecd6d78604253958a9d0136bab9fb)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:29.778631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c8fad-bcb1-4c7b-89f8-8c80f44bf458 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:29.780372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 530/1053] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:55:29 2022] GET /identity/v3/projects/568ecd6d78604253958a9d0136bab9fb => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:29.786123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c8fad-bcb1-4c7b-89f8-8c80f44bf458 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:29.801482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:29.809694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:29.819296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 524/1054] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:29.842707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e8749-3ef8-4dd0-90ce-59b202e9c776 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:29.899000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c8fad-bcb1-4c7b-89f8-8c80f44bf458 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:29.937279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66675289-9bd0-4f93-8755-a05bf86dc0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:29.937928 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66675289-9bd0-4f93-8755-a05bf86dc0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:29.938212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66675289-9bd0-4f93-8755-a05bf86dc0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:29.938495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66675289-9bd0-4f93-8755-a05bf86dc0e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:29.939358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66675289-9bd0-4f93-8755-a05bf86dc0e8 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=568ecd6d78604253958a9d0136bab9fb, user.id=7041713f420a44a5813381a72667264b) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:29.939669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66675289-9bd0-4f93-8755-a05bf86dc0e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:29.941187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66675289-9bd0-4f93-8755-a05bf86dc0e8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:29.946725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 531/1055] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:29 2022] GET /identity/v3/role_assignments?user.id=7041713f420a44a5813381a72667264b&scope.project.id=568ecd6d78604253958a9d0136bab9fb&role.id=af8084c48e3c40298e26d44d6d14595a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:29.960686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e8749-3ef8-4dd0-90ce-59b202e9c776 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:30.000939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289e0e9-0322-44e0-ab01-fe384ca88937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:30.001772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289e0e9-0322-44e0-ab01-fe384ca88937 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:30.002029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289e0e9-0322-44e0-ab01-fe384ca88937 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:30.002304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289e0e9-0322-44e0-ab01-fe384ca88937 None admin] PATH_INFO: `/v3/services/image` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:30.003000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289e0e9-0322-44e0-ab01-fe384ca88937 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:30.004423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289e0e9-0322-44e0-ab01-fe384ca88937 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3289e0e9-0322-44e0-ab01-fe384ca88937 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:30.017675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:30.024360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:30.025355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 525/1056] 10.222.0.30 () {56 vars in 1105 bytes} [Mon May 23 17:55:29 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:30.026202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66675289-9bd0-4f93-8755-a05bf86dc0e8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:30.115844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:30.135658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66675289-9bd0-4f93-8755-a05bf86dc0e8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:30.171806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a10749-99a0-4084-819a-85ee1ac96db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:30.172477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a10749-99a0-4084-819a-85ee1ac96db3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:30.172762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a10749-99a0-4084-819a-85ee1ac96db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:30.173040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a10749-99a0-4084-819a-85ee1ac96db3 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:30.173747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a10749-99a0-4084-819a-85ee1ac96db3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:30.174057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a10749-99a0-4084-819a-85ee1ac96db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:30.175445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a10749-99a0-4084-819a-85ee1ac96db3 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:30.185837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 532/1057] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:30.187107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289e0e9-0322-44e0-ab01-fe384ca88937 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:30.242661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:30.294164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289e0e9-0322-44e0-ab01-fe384ca88937 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:30.327936 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867203ce-98af-4777-ac6f-5d3c0b7424e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:30.328601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867203ce-98af-4777-ac6f-5d3c0b7424e5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:30.328885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867203ce-98af-4777-ac6f-5d3c0b7424e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:30.329158 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867203ce-98af-4777-ac6f-5d3c0b7424e5 None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:30.329858 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867203ce-98af-4777-ac6f-5d3c0b7424e5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:30.330163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867203ce-98af-4777-ac6f-5d3c0b7424e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:30.331562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867203ce-98af-4777-ac6f-5d3c0b7424e5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:30.342000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 526/1058] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:30.342958 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a10749-99a0-4084-819a-85ee1ac96db3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:30.445118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a10749-99a0-4084-819a-85ee1ac96db3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:30.479753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eda80d-9057-47d1-9191-2d55c1adbd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:30.480413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eda80d-9057-47d1-9191-2d55c1adbd29 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:30.480696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eda80d-9057-47d1-9191-2d55c1adbd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:30.480973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eda80d-9057-47d1-9191-2d55c1adbd29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:30.481718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eda80d-9057-47d1-9191-2d55c1adbd29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:30.483109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eda80d-9057-47d1-9191-2d55c1adbd29 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:30.510727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 533/1059] 10.222.0.30 () {60 vars in 1144 bytes} [Mon May 23 17:55:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:55:30.903152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82160062-47a5-4e98-b11f-16608ef129e8 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:30.903473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82160062-47a5-4e98-b11f-16608ef129e8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:30.903711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82160062-47a5-4e98-b11f-16608ef129e8 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:30.905078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 527/1060] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:30.910370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479af85-e8d1-494f-b9b6-193407286bd7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:30.910661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479af85-e8d1-494f-b9b6-193407286bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:30.910970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479af85-e8d1-494f-b9b6-193407286bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:30.917188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:30.928521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1479af85-e8d1-494f-b9b6-193407286bd7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:30.929736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1479af85-e8d1-494f-b9b6-193407286bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:31.006737 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 534/1061] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:31.029570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82160062-47a5-4e98-b11f-16608ef129e8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:31.136683 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82160062-47a5-4e98-b11f-16608ef129e8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:31.153364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:31.173396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec084574-3cb5-40a3-9fc6-c5a8ddd8ce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:31.174208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084574-3cb5-40a3-9fc6-c5a8ddd8ce14 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:31.174495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084574-3cb5-40a3-9fc6-c5a8ddd8ce14 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:31.174795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084574-3cb5-40a3-9fc6-c5a8ddd8ce14 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:31.185767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec084574-3cb5-40a3-9fc6-c5a8ddd8ce14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ec084574-3cb5-40a3-9fc6-c5a8ddd8ce14 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:31.193939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:31.195250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:31.196213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:31.199029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 528/1062] 10.222.0.30 () {56 vars in 1120 bytes} [Mon May 23 17:55:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:31.201272 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479af85-e8d1-494f-b9b6-193407286bd7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:31.303689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479af85-e8d1-494f-b9b6-193407286bd7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:31.333590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:31.341109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fafbc7-fedf-41fe-b15c-27a07be7b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:31.341781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fafbc7-fedf-41fe-b15c-27a07be7b449 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:31.342070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fafbc7-fedf-41fe-b15c-27a07be7b449 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:31.342346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fafbc7-fedf-41fe-b15c-27a07be7b449 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:31.343166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fafbc7-fedf-41fe-b15c-27a07be7b449 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:31.343473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fafbc7-fedf-41fe-b15c-27a07be7b449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:31.344883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fafbc7-fedf-41fe-b15c-27a07be7b449 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:31.357874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 535/1063] 10.222.0.30 () {56 vars in 1115 bytes} [Mon May 23 17:55:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:31.359487 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec084574-3cb5-40a3-9fc6-c5a8ddd8ce14 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:31.463364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec084574-3cb5-40a3-9fc6-c5a8ddd8ce14 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:31.498654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282ddff-f8a8-46c7-b14a-510b694d3505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:31.499461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282ddff-f8a8-46c7-b14a-510b694d3505 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:31.499741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282ddff-f8a8-46c7-b14a-510b694d3505 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:31.500014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282ddff-f8a8-46c7-b14a-510b694d3505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:31.514859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282ddff-f8a8-46c7-b14a-510b694d3505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:31.516321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282ddff-f8a8-46c7-b14a-510b694d3505 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-e282ddff-f8a8-46c7-b14a-510b694d3505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:31.535210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:31.536114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:31.542684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:31.542684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:31.542684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:31.542684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:31.542684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 529/1064] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:31.544545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fafbc7-fedf-41fe-b15c-27a07be7b449 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:31.652531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fafbc7-fedf-41fe-b15c-27a07be7b449 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:31.692388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa006-5878-4907-b197-c413413794b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:31.693057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa006-5878-4907-b197-c413413794b9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:31.693343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa006-5878-4907-b197-c413413794b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:31.693627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa006-5878-4907-b197-c413413794b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:31.695006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa006-5878-4907-b197-c413413794b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:31.695309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa006-5878-4907-b197-c413413794b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:31.696673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa006-5878-4907-b197-c413413794b9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:31.714084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 536/1065] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:31.715706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282ddff-f8a8-46c7-b14a-510b694d3505 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:31.746083 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:31.821251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282ddff-f8a8-46c7-b14a-510b694d3505 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:31.856288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c30a2-0e32-4fdc-814b-2cbe73cf157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:31.857071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c30a2-0e32-4fdc-814b-2cbe73cf157b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:31.857350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c30a2-0e32-4fdc-814b-2cbe73cf157b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:31.857619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c30a2-0e32-4fdc-814b-2cbe73cf157b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:31.864945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c30a2-0e32-4fdc-814b-2cbe73cf157b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:31.866542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c30a2-0e32-4fdc-814b-2cbe73cf157b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-9f5c30a2-0e32-4fdc-814b-2cbe73cf157b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:55:31.880545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:31.881542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:31.882504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:31.882504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:31.882504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:55:31.882504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:55:31.882504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:55:31.882504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:55:31.882504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:55:31.882504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:55:31.882504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:55:31.882504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:31.886882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 530/1066] 10.222.0.30 () {56 vars in 1093 bytes} [Mon May 23 17:55:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:31.887857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa006-5878-4907-b197-c413413794b9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:31.941541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:31.991261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa006-5878-4907-b197-c413413794b9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:32.027934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a831a-f6c4-4586-aece-8f7b6223ae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:32.028600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a831a-f6c4-4586-aece-8f7b6223ae8e None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.028877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a831a-f6c4-4586-aece-8f7b6223ae8e None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.029150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a831a-f6c4-4586-aece-8f7b6223ae8e None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.029977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a831a-f6c4-4586-aece-8f7b6223ae8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:32.030281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a831a-f6c4-4586-aece-8f7b6223ae8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:32.031710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a831a-f6c4-4586-aece-8f7b6223ae8e None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:32.049609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 537/1067] 10.222.0.30 () {56 vars in 1133 bytes} [Mon May 23 17:55:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:32.055200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c30a2-0e32-4fdc-814b-2cbe73cf157b None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:32.143853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:32.157503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c30a2-0e32-4fdc-814b-2cbe73cf157b None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:32.180222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51005c-8005-4b4d-826a-4b6876f62185 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.180550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51005c-8005-4b4d-826a-4b6876f62185 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.180786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51005c-8005-4b4d-826a-4b6876f62185 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.182311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 538/1068] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:32.187182 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc174c7-86ca-4107-bdee-fa964b253544 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.187472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc174c7-86ca-4107-bdee-fa964b253544 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.187756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc174c7-86ca-4107-bdee-fa964b253544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.192046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e79b8-2546-47ea-8216-53652f22f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:32.192841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e79b8-2546-47ea-8216-53652f22f441 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.193122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e79b8-2546-47ea-8216-53652f22f441 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.193398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e79b8-2546-47ea-8216-53652f22f441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.205033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9cc174c7-86ca-4107-bdee-fa964b253544 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:32.206312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9cc174c7-86ca-4107-bdee-fa964b253544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:32.206533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e79b8-2546-47ea-8216-53652f22f441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:32.207970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e79b8-2546-47ea-8216-53652f22f441 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-788e79b8-2546-47ea-8216-53652f22f441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:32.227238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:32.228200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:32.229104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:32.229104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:32.229104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:32.229104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:32.232990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 531/1069] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:32.234021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e79b8-2546-47ea-8216-53652f22f441 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:32.279296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 539/1070] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:32.305018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc174c7-86ca-4107-bdee-fa964b253544 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:32.349907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e79b8-2546-47ea-8216-53652f22f441 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:32.354181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:32.389389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a175a52-42ce-4922-9f8e-bacb8ebf2b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:32.390058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175a52-42ce-4922-9f8e-bacb8ebf2b03 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.390337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175a52-42ce-4922-9f8e-bacb8ebf2b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.390621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175a52-42ce-4922-9f8e-bacb8ebf2b03 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.391371 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a175a52-42ce-4922-9f8e-bacb8ebf2b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:32.391687 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a175a52-42ce-4922-9f8e-bacb8ebf2b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:32.393055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a175a52-42ce-4922-9f8e-bacb8ebf2b03 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:32.402795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:32.411080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 532/1071] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:32.412628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a175a52-42ce-4922-9f8e-bacb8ebf2b03 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:32.421209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc174c7-86ca-4107-bdee-fa964b253544 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:32.457464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a92fb-a4b8-4a20-87ea-4b898985ec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:32.458256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a92fb-a4b8-4a20-87ea-4b898985ec3f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.458536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a92fb-a4b8-4a20-87ea-4b898985ec3f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.458854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a92fb-a4b8-4a20-87ea-4b898985ec3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.470853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a92fb-a4b8-4a20-87ea-4b898985ec3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b77a92fb-a4b8-4a20-87ea-4b898985ec3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:32.478978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:32.479962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:32.480837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 540/1072] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:55:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:32.486231 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a92fb-a4b8-4a20-87ea-4b898985ec3f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:32.528962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a175a52-42ce-4922-9f8e-bacb8ebf2b03 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:32.567425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf022c0-c201-49d3-a406-0e172ddd4eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:32.568166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf022c0-c201-49d3-a406-0e172ddd4eff None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.568454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf022c0-c201-49d3-a406-0e172ddd4eff None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.568733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf022c0-c201-49d3-a406-0e172ddd4eff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.577179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf022c0-c201-49d3-a406-0e172ddd4eff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:32.578673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf022c0-c201-49d3-a406-0e172ddd4eff None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-daf022c0-c201-49d3-a406-0e172ddd4eff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:55:32.593403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:32.594550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:32.595509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:55:32.595509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:55:32.595509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:55:32.595509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:55:32.595509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:55:32.595509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:55:32.595509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:32.595509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:32.595509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 533/1073] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:32.600216 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf022c0-c201-49d3-a406-0e172ddd4eff None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:32.606164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:32.609476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a92fb-a4b8-4a20-87ea-4b898985ec3f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:32.645042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea320bfa-4e35-44b4-93d9-e39518d8531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:32.645851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320bfa-4e35-44b4-93d9-e39518d8531a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.646144 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320bfa-4e35-44b4-93d9-e39518d8531a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.646422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320bfa-4e35-44b4-93d9-e39518d8531a None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.647203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea320bfa-4e35-44b4-93d9-e39518d8531a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:32.648045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea320bfa-4e35-44b4-93d9-e39518d8531a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:32.649405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea320bfa-4e35-44b4-93d9-e39518d8531a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:32.662355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 541/1074] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:55:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:32.663492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea320bfa-4e35-44b4-93d9-e39518d8531a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:32.668614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:32.715054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf022c0-c201-49d3-a406-0e172ddd4eff None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:32.750500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efb514-89be-42ec-bb6d-2edd62b8a1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:32.751198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb514-89be-42ec-bb6d-2edd62b8a1fb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.751489 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb514-89be-42ec-bb6d-2edd62b8a1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.751770 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb514-89be-42ec-bb6d-2edd62b8a1fb None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.752552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efb514-89be-42ec-bb6d-2edd62b8a1fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:32.752865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efb514-89be-42ec-bb6d-2edd62b8a1fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:32.754291 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efb514-89be-42ec-bb6d-2edd62b8a1fb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:32.767442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 534/1075] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:32.768676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b45b5-f3d9-4d38-9b62-36dc204fbae3 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.768966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b45b5-f3d9-4d38-9b62-36dc204fbae3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.769245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b45b5-f3d9-4d38-9b62-36dc204fbae3 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.770621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 535/1076] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:32.773238 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea320bfa-4e35-44b4-93d9-e39518d8531a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:32.775303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b45b5-f3d9-4d38-9b62-36dc204fbae3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:32.807561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80157ccb-0a59-4f87-b2c8-cd1be919d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:32.808420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157ccb-0a59-4f87-b2c8-cd1be919d289 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.808695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157ccb-0a59-4f87-b2c8-cd1be919d289 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.808962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157ccb-0a59-4f87-b2c8-cd1be919d289 None admin] PATH_INFO: `/v3/users/7041713f420a44a5813381a72667264b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.810148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80157ccb-0a59-4f87-b2c8-cd1be919d289 None admin] RBAC: Authorizing `identity:get_user(user_id=7041713f420a44a5813381a72667264b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:32.811595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80157ccb-0a59-4f87-b2c8-cd1be919d289 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:32.813219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 542/1077] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:32 2022] GET /identity/v3/users/7041713f420a44a5813381a72667264b => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:32.814400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f7d-1e84-4f64-a6d0-1287a6dde483 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.814677 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f7d-1e84-4f64-a6d0-1287a6dde483 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.814978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f7d-1e84-4f64-a6d0-1287a6dde483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.831489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b15e0f7d-1e84-4f64-a6d0-1287a6dde483 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:32.832582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b15e0f7d-1e84-4f64-a6d0-1287a6dde483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:32.855767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:32.881124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b45b5-f3d9-4d38-9b62-36dc204fbae3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:32.900369 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 543/1078] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:32.901189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e0f7d-1e84-4f64-a6d0-1287a6dde483 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:32.902048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:32.920254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da4ad-110b-429c-bd2b-c1f3938a132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:32.921145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da4ad-110b-429c-bd2b-c1f3938a132a None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:32.921429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da4ad-110b-429c-bd2b-c1f3938a132a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:32.921751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da4ad-110b-429c-bd2b-c1f3938a132a None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/9021e2249e11489083139e210562ce44/roles/a25a64439bdc4250924866297524814c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:32.924105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6da4ad-110b-429c-bd2b-c1f3938a132a None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=9021e2249e11489083139e210562ce44, role_id=a25a64439bdc4250924866297524814c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:32.925911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6da4ad-110b-429c-bd2b-c1f3938a132a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:32.939775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 536/1079] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:55:32 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/9021e2249e11489083139e210562ce44/roles/a25a64439bdc4250924866297524814c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:55:32.940587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da4ad-110b-429c-bd2b-c1f3938a132a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:33.021591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e0f7d-1e84-4f64-a6d0-1287a6dde483 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:33.055043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da4ad-110b-429c-bd2b-c1f3938a132a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:33.059788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856495b-f5fe-4f3b-a73b-cc5fdf3294f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:33.060656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856495b-f5fe-4f3b-a73b-cc5fdf3294f5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:33.060935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856495b-f5fe-4f3b-a73b-cc5fdf3294f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:33.061203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856495b-f5fe-4f3b-a73b-cc5fdf3294f5 None admin] PATH_INFO: `/v3/projects/568ecd6d78604253958a9d0136bab9fb` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:33.062427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856495b-f5fe-4f3b-a73b-cc5fdf3294f5 None admin] RBAC: Authorizing `identity:get_project(project_id=568ecd6d78604253958a9d0136bab9fb)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:33.063923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856495b-f5fe-4f3b-a73b-cc5fdf3294f5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:33.065832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 544/1080] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:55:32 2022] GET /identity/v3/projects/568ecd6d78604253958a9d0136bab9fb => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:33.072614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856495b-f5fe-4f3b-a73b-cc5fdf3294f5 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:33.095746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a698e0-3632-4706-b7b7-8a17bb61a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:33.096305 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a698e0-3632-4706-b7b7-8a17bb61a31d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:33.096717 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a698e0-3632-4706-b7b7-8a17bb61a31d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:33.097063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a698e0-3632-4706-b7b7-8a17bb61a31d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:33.104152 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:33.158222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:33.183627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a698e0-3632-4706-b7b7-8a17bb61a31d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:33.185850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a698e0-3632-4706-b7b7-8a17bb61a31d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:33.188963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856495b-f5fe-4f3b-a73b-cc5fdf3294f5 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:33.228596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81e64d-5475-4ee2-9220-adb8edde1768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:33.229490 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81e64d-5475-4ee2-9220-adb8edde1768 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:33.229772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81e64d-5475-4ee2-9220-adb8edde1768 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:33.230051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81e64d-5475-4ee2-9220-adb8edde1768 None admin] PATH_INFO: `/v3/projects/568ecd6d78604253958a9d0136bab9fb/users/7041713f420a44a5813381a72667264b/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:33.232111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81e64d-5475-4ee2-9220-adb8edde1768 None admin] RBAC: Authorizing `identity:create_grant(project_id=568ecd6d78604253958a9d0136bab9fb, user_id=7041713f420a44a5813381a72667264b, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:33.233545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81e64d-5475-4ee2-9220-adb8edde1768 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:33.253944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 545/1081] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:55:33 2022] PUT /identity/v3/projects/568ecd6d78604253958a9d0136bab9fb/users/7041713f420a44a5813381a72667264b/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 17:55:33.303446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 537/1082] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:55:33.309138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81e64d-5475-4ee2-9220-adb8edde1768 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:33.408467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:33.424843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81e64d-5475-4ee2-9220-adb8edde1768 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:33.465945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c1cd7-2ead-4bbb-8d5f-4f1c839c7387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:33.466768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c1cd7-2ead-4bbb-8d5f-4f1c839c7387 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:33.467059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c1cd7-2ead-4bbb-8d5f-4f1c839c7387 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:33.467340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c1cd7-2ead-4bbb-8d5f-4f1c839c7387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:33.478668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c1cd7-2ead-4bbb-8d5f-4f1c839c7387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:33.480211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c1cd7-2ead-4bbb-8d5f-4f1c839c7387 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-a96c1cd7-2ead-4bbb-8d5f-4f1c839c7387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:33.497971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:33.499199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:33.500137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:33.500137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:33.500137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:33.500137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:33.500137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 546/1083] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:33.505321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a698e0-3632-4706-b7b7-8a17bb61a31d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:33.594986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:33.621682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a698e0-3632-4706-b7b7-8a17bb61a31d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:33.666253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880f448-f0b0-4059-aa26-eba8d2f9455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:33.666881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880f448-f0b0-4059-aa26-eba8d2f9455d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:33.667162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880f448-f0b0-4059-aa26-eba8d2f9455d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:33.667433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880f448-f0b0-4059-aa26-eba8d2f9455d None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:33.668144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880f448-f0b0-4059-aa26-eba8d2f9455d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:33.668443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880f448-f0b0-4059-aa26-eba8d2f9455d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:33.669801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880f448-f0b0-4059-aa26-eba8d2f9455d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:33.686743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 538/1084] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:35.169825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565fbb-4541-4866-b5ec-2394e3d3f16a None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:35.170355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565fbb-4541-4866-b5ec-2394e3d3f16a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:35.170355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565fbb-4541-4866-b5ec-2394e3d3f16a None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:35.171765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 547/1085] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:35.176786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39df3a-054d-4b64-9ff4-b774f3bca309 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:35.177168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39df3a-054d-4b64-9ff4-b774f3bca309 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:35.177455 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39df3a-054d-4b64-9ff4-b774f3bca309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:35.194840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6e39df3a-054d-4b64-9ff4-b774f3bca309 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:35.196294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6e39df3a-054d-4b64-9ff4-b774f3bca309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:35.261295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 539/1086] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:35.284788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565fbb-4541-4866-b5ec-2394e3d3f16a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:35.388512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565fbb-4541-4866-b5ec-2394e3d3f16a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:35.421682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d571-c9f8-4f4d-b20b-e07486047e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:35.422409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d571-c9f8-4f4d-b20b-e07486047e00 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:35.422684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d571-c9f8-4f4d-b20b-e07486047e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:35.422984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d571-c9f8-4f4d-b20b-e07486047e00 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:35.430493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:35.433644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d571-c9f8-4f4d-b20b-e07486047e00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b130d571-c9f8-4f4d-b20b-e07486047e00 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:35.442487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:35.443556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:35.445258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 548/1087] 10.222.0.30 () {56 vars in 1120 bytes} [Mon May 23 17:55:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:35.450203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39df3a-054d-4b64-9ff4-b774f3bca309 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:35.485822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653ecfd-1424-4f96-b1d5-fdf467e9d91e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:35.486100 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653ecfd-1424-4f96-b1d5-fdf467e9d91e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:35.486376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653ecfd-1424-4f96-b1d5-fdf467e9d91e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:35.487778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 549/1088] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:55:35.493289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99de55-bae0-4498-a041-7293c9cabecd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:35.493578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99de55-bae0-4498-a041-7293c9cabecd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:35.493859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99de55-bae0-4498-a041-7293c9cabecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:35.511105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7b99de55-bae0-4498-a041-7293c9cabecd None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:35.512297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7b99de55-bae0-4498-a041-7293c9cabecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:35.520557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:35.553482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39df3a-054d-4b64-9ff4-b774f3bca309 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:35.581218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 550/1089] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:35.588630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b7495-f579-4bfb-bca3-8eeaefc06805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:35.589291 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b7495-f579-4bfb-bca3-8eeaefc06805 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:35.589575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b7495-f579-4bfb-bca3-8eeaefc06805 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:35.589838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b7495-f579-4bfb-bca3-8eeaefc06805 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:35.590573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b7495-f579-4bfb-bca3-8eeaefc06805 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:35.590907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b7495-f579-4bfb-bca3-8eeaefc06805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:35.592266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b7495-f579-4bfb-bca3-8eeaefc06805 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:35.604516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 540/1090] 10.222.0.30 () {56 vars in 1115 bytes} [Mon May 23 17:55:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:35.604689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99de55-bae0-4498-a041-7293c9cabecd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:35.606943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b7495-f579-4bfb-bca3-8eeaefc06805 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:35.708689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99de55-bae0-4498-a041-7293c9cabecd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:35.712586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b7495-f579-4bfb-bca3-8eeaefc06805 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:35.737437 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:35.740901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:35.745601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e221f1-10d3-4871-9e7d-fb76dd78c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:35.746393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e221f1-10d3-4871-9e7d-fb76dd78c0bb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:35.746675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e221f1-10d3-4871-9e7d-fb76dd78c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:35.746983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e221f1-10d3-4871-9e7d-fb76dd78c0bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:35.747873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6cc3c-3be1-4195-aa89-72c823a772a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:35.749061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6cc3c-3be1-4195-aa89-72c823a772a4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:35.749343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6cc3c-3be1-4195-aa89-72c823a772a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:35.749619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6cc3c-3be1-4195-aa89-72c823a772a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:35.758773 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e221f1-10d3-4871-9e7d-fb76dd78c0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:35.765762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6cc3c-3be1-4195-aa89-72c823a772a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-c9e221f1-10d3-4871-9e7d-fb76dd78c0bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:35.766565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:35.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:55:35.769409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:35.770054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6cc3c-3be1-4195-aa89-72c823a772a4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:35.770140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 551/1091] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:55:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:35.773903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e221f1-10d3-4871-9e7d-fb76dd78c0bb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-05f6cc3c-3be1-4195-aa89-72c823a772a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:35.789823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:35.790940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:35.791849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:35.791849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:35.791849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:35.791849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:35.791849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 541/1092] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:35.798942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6cc3c-3be1-4195-aa89-72c823a772a4 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:35.885622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e221f1-10d3-4871-9e7d-fb76dd78c0bb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:35.908911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6cc3c-3be1-4195-aa89-72c823a772a4 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:35.924956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71e14d-0d1b-4aa9-a001-c6f0ed55da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:35.925627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71e14d-0d1b-4aa9-a001-c6f0ed55da2f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:35.925911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71e14d-0d1b-4aa9-a001-c6f0ed55da2f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:35.926188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71e14d-0d1b-4aa9-a001-c6f0ed55da2f None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:35.926983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71e14d-0d1b-4aa9-a001-c6f0ed55da2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:35.927290 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71e14d-0d1b-4aa9-a001-c6f0ed55da2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:35.929381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71e14d-0d1b-4aa9-a001-c6f0ed55da2f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:35.937968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 552/1093] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:35.944723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71e14d-0d1b-4aa9-a001-c6f0ed55da2f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:35.949160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99c1a-18a0-44b2-a895-a2eeffafc66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:35.950129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99c1a-18a0-44b2-a895-a2eeffafc66c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:35.950548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99c1a-18a0-44b2-a895-a2eeffafc66c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:35.950988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99c1a-18a0-44b2-a895-a2eeffafc66c None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:35.952086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d99c1a-18a0-44b2-a895-a2eeffafc66c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:35.952550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d99c1a-18a0-44b2-a895-a2eeffafc66c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:35.954667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d99c1a-18a0-44b2-a895-a2eeffafc66c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:35.971965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 542/1094] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:35.978824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99c1a-18a0-44b2-a895-a2eeffafc66c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:36.008718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:36.030893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:36.064341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71e14d-0d1b-4aa9-a001-c6f0ed55da2f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:36.097764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99c1a-18a0-44b2-a895-a2eeffafc66c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:36.099419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4c842-5749-4334-9d6d-096bc9b6a912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:36.100296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4c842-5749-4334-9d6d-096bc9b6a912 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:36.101098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4c842-5749-4334-9d6d-096bc9b6a912 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:36.101374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4c842-5749-4334-9d6d-096bc9b6a912 None admin] PATH_INFO: `/v3/users/7041713f420a44a5813381a72667264b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:36.103166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4c842-5749-4334-9d6d-096bc9b6a912 None admin] RBAC: Authorizing `identity:get_user(user_id=7041713f420a44a5813381a72667264b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:36.105014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4c842-5749-4334-9d6d-096bc9b6a912 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:36.106913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 553/1095] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:35 2022] GET /identity/v3/users/7041713f420a44a5813381a72667264b => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:36.112983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4c842-5749-4334-9d6d-096bc9b6a912 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:36.140600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9460c-8d8e-4bb9-bed4-f5811a166ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:36.141463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9460c-8d8e-4bb9-bed4-f5811a166ade None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:36.141733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9460c-8d8e-4bb9-bed4-f5811a166ade None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:36.141997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9460c-8d8e-4bb9-bed4-f5811a166ade None admin] PATH_INFO: `/v3/users/nova` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:36.149991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9460c-8d8e-4bb9-bed4-f5811a166ade None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:36.151472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9460c-8d8e-4bb9-bed4-f5811a166ade None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-44a9460c-8d8e-4bb9-bed4-f5811a166ade None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:55:36.170676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:36.171885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:36.173043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 543/1096] 10.222.0.30 () {56 vars in 1093 bytes} [Mon May 23 17:55:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:55:36.179890 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9460c-8d8e-4bb9-bed4-f5811a166ade None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:36.221703 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4c842-5749-4334-9d6d-096bc9b6a912 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:36.244587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:36.259706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31747c14-f19c-4de6-aeae-c3b8b8d11566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:36.260360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31747c14-f19c-4de6-aeae-c3b8b8d11566 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:36.260646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31747c14-f19c-4de6-aeae-c3b8b8d11566 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:36.261027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31747c14-f19c-4de6-aeae-c3b8b8d11566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:36.287347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9460c-8d8e-4bb9-bed4-f5811a166ade None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:36.290286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:36.328564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50286f-dbac-4fc8-962f-e8d3aa9d65b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:36.329240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50286f-dbac-4fc8-962f-e8d3aa9d65b3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:36.329520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50286f-dbac-4fc8-962f-e8d3aa9d65b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:36.329793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50286f-dbac-4fc8-962f-e8d3aa9d65b3 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:36.330626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50286f-dbac-4fc8-962f-e8d3aa9d65b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:36.330966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50286f-dbac-4fc8-962f-e8d3aa9d65b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:36.332600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50286f-dbac-4fc8-962f-e8d3aa9d65b3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:36.338985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31747c14-f19c-4de6-aeae-c3b8b8d11566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:36.340452 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31747c14-f19c-4de6-aeae-c3b8b8d11566 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:36.353305 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 544/1097] 10.222.0.30 () {56 vars in 1133 bytes} [Mon May 23 17:55:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:36.359113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50286f-dbac-4fc8-962f-e8d3aa9d65b3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:36.465460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 554/1098] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 17:55:36.471371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31747c14-f19c-4de6-aeae-c3b8b8d11566 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:36.472484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50286f-dbac-4fc8-962f-e8d3aa9d65b3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:36.494482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:36.510649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db4c72-289e-4fe9-b3d1-032b978d6d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:36.511345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db4c72-289e-4fe9-b3d1-032b978d6d07 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:36.511698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db4c72-289e-4fe9-b3d1-032b978d6d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:36.512037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db4c72-289e-4fe9-b3d1-032b978d6d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:36.545696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:36.583101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31747c14-f19c-4de6-aeae-c3b8b8d11566 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:36.587260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db4c72-289e-4fe9-b3d1-032b978d6d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:36.588741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db4c72-289e-4fe9-b3d1-032b978d6d07 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:36.618772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9960b-395f-4f27-a44f-53ca2eedfe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:36.619621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9960b-395f-4f27-a44f-53ca2eedfe40 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:36.619903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9960b-395f-4f27-a44f-53ca2eedfe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:36.620176 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9960b-395f-4f27-a44f-53ca2eedfe40 None admin] PATH_INFO: `/v3/projects/568ecd6d78604253958a9d0136bab9fb` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:36.621348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9960b-395f-4f27-a44f-53ca2eedfe40 None admin] RBAC: Authorizing `identity:get_project(project_id=568ecd6d78604253958a9d0136bab9fb)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:36.622782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9960b-395f-4f27-a44f-53ca2eedfe40 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:36.624471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 555/1099] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:55:36 2022] GET /identity/v3/projects/568ecd6d78604253958a9d0136bab9fb => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:36.630368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9960b-395f-4f27-a44f-53ca2eedfe40 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:36.687392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 545/1100] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 17:55:36.693113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db4c72-289e-4fe9-b3d1-032b978d6d07 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:36.716441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:36.728741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9960b-395f-4f27-a44f-53ca2eedfe40 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:36.752619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:36.763422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406f8f3-c2bc-41a2-9656-799bc79b441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:36.764016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406f8f3-c2bc-41a2-9656-799bc79b441f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:36.764301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406f8f3-c2bc-41a2-9656-799bc79b441f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:36.764580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406f8f3-c2bc-41a2-9656-799bc79b441f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:36.765402 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406f8f3-c2bc-41a2-9656-799bc79b441f None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=568ecd6d78604253958a9d0136bab9fb, user.id=7041713f420a44a5813381a72667264b) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:36.765714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406f8f3-c2bc-41a2-9656-799bc79b441f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:36.767164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406f8f3-c2bc-41a2-9656-799bc79b441f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:36.773762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 556/1101] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:36 2022] GET /identity/v3/role_assignments?user.id=7041713f420a44a5813381a72667264b&scope.project.id=568ecd6d78604253958a9d0136bab9fb&role.id=af8084c48e3c40298e26d44d6d14595a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:55:36.792649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db4c72-289e-4fe9-b3d1-032b978d6d07 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:36.830198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793ae85-5254-4d94-b36b-b5079a73370d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:36.831131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ae85-5254-4d94-b36b-b5079a73370d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:36.831457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ae85-5254-4d94-b36b-b5079a73370d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:36.831761 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ae85-5254-4d94-b36b-b5079a73370d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:36.844600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793ae85-5254-4d94-b36b-b5079a73370d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:36.846078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793ae85-5254-4d94-b36b-b5079a73370d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-7793ae85-5254-4d94-b36b-b5079a73370d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:55:36.864953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:36.866180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:36.867631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:55:36.867631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:55:36.867631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:55:36.867631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:36.871076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 546/1102] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:36.872169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406f8f3-c2bc-41a2-9656-799bc79b441f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:36.979461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406f8f3-c2bc-41a2-9656-799bc79b441f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:37.016270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9532f35-dbbc-4d3c-bda7-1e9ef87958ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:37.016863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9532f35-dbbc-4d3c-bda7-1e9ef87958ff None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:37.017148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9532f35-dbbc-4d3c-bda7-1e9ef87958ff None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:37.017425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9532f35-dbbc-4d3c-bda7-1e9ef87958ff None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:37.018149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9532f35-dbbc-4d3c-bda7-1e9ef87958ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:37.018456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9532f35-dbbc-4d3c-bda7-1e9ef87958ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:37.019917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9532f35-dbbc-4d3c-bda7-1e9ef87958ff None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:37.031947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 557/1103] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:37.037595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793ae85-5254-4d94-b36b-b5079a73370d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:37.137709 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793ae85-5254-4d94-b36b-b5079a73370d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:37.151765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:37.171625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855dd44-5347-403b-a3e9-7933ffa58be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:37.172417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855dd44-5347-403b-a3e9-7933ffa58be9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:37.172696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855dd44-5347-403b-a3e9-7933ffa58be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:37.172966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855dd44-5347-403b-a3e9-7933ffa58be9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:37.180035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855dd44-5347-403b-a3e9-7933ffa58be9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:37.181462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855dd44-5347-403b-a3e9-7933ffa58be9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f855dd44-5347-403b-a3e9-7933ffa58be9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:55:37.195071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:37.196206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:37.197617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:55:37.197617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:55:37.197617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:55:37.197617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:55:37.197617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:55:37.197617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:55:37.197617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:55:37.197617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:55:37.197617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 547/1104] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:37.201864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9532f35-dbbc-4d3c-bda7-1e9ef87958ff None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:37.217537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:37.305219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9532f35-dbbc-4d3c-bda7-1e9ef87958ff None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:37.338688 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2678-9099-472c-ba22-9547fe64f5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:37.339362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2678-9099-472c-ba22-9547fe64f5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:37.339645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2678-9099-472c-ba22-9547fe64f5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:37.339917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2678-9099-472c-ba22-9547fe64f5f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:37.340693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b2678-9099-472c-ba22-9547fe64f5f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:37.341002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b2678-9099-472c-ba22-9547fe64f5f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:37.342416 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b2678-9099-472c-ba22-9547fe64f5f8 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:37.354726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 558/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:37.360771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855dd44-5347-403b-a3e9-7933ffa58be9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:37.459159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855dd44-5347-403b-a3e9-7933ffa58be9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:37.492444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d90680-168f-451c-a4a7-6f8df378ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:37.493103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90680-168f-451c-a4a7-6f8df378ec4d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:37.493387 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90680-168f-451c-a4a7-6f8df378ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:37.493662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90680-168f-451c-a4a7-6f8df378ec4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:37.494478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d90680-168f-451c-a4a7-6f8df378ec4d None admin] RBAC: Adding query filter params (role.id=a25a64439bdc4250924866297524814c, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=9021e2249e11489083139e210562ce44) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:37.494819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d90680-168f-451c-a4a7-6f8df378ec4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:37.496249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d90680-168f-451c-a4a7-6f8df378ec4d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:37.514730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 548/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:37 2022] GET /identity/v3/role_assignments?user.id=9021e2249e11489083139e210562ce44&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=a25a64439bdc4250924866297524814c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:39.039957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9056df6-7cfd-4a79-a3b3-2d1d6555df6a None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:39.040519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9056df6-7cfd-4a79-a3b3-2d1d6555df6a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:39.040519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9056df6-7cfd-4a79-a3b3-2d1d6555df6a None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:39.041877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 559/1107] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:39.047344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8738705-c67e-4e5f-bbc1-5c47b5fceaf3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:39.047757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8738705-c67e-4e5f-bbc1-5c47b5fceaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:39.047898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8738705-c67e-4e5f-bbc1-5c47b5fceaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:39.064925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d8738705-c67e-4e5f-bbc1-5c47b5fceaf3 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:39.066090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d8738705-c67e-4e5f-bbc1-5c47b5fceaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:39.094244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:39.131271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 549/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:39.157956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9056df6-7cfd-4a79-a3b3-2d1d6555df6a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:39.227824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:39.258001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9056df6-7cfd-4a79-a3b3-2d1d6555df6a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:39.291943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45de01a-0f92-44d1-a7f0-a989a0efcc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:39.292660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de01a-0f92-44d1-a7f0-a989a0efcc31 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:39.292942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de01a-0f92-44d1-a7f0-a989a0efcc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:39.293216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de01a-0f92-44d1-a7f0-a989a0efcc31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:39.294370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45de01a-0f92-44d1-a7f0-a989a0efcc31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:39.295838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45de01a-0f92-44d1-a7f0-a989a0efcc31 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:39.297440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 560/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:39.303140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8738705-c67e-4e5f-bbc1-5c47b5fceaf3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:39.400333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8738705-c67e-4e5f-bbc1-5c47b5fceaf3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:39.432912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e747-2532-4877-be9d-89826cfd235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:39.433575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e747-2532-4877-be9d-89826cfd235a None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:39.433860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e747-2532-4877-be9d-89826cfd235a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:39.434135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e747-2532-4877-be9d-89826cfd235a None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:39.434872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e747-2532-4877-be9d-89826cfd235a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:39.436296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e747-2532-4877-be9d-89826cfd235a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:39.454865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 550/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:55:39 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:55:41.694685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111cf55-5c6b-456a-b9fa-ec2f5407d075 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:41.695228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111cf55-5c6b-456a-b9fa-ec2f5407d075 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:41.695228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111cf55-5c6b-456a-b9fa-ec2f5407d075 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:41.696604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 561/1111] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:41.701917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65262b13-81cf-48d1-9d3e-b38ed2a6be90 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:41.702336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65262b13-81cf-48d1-9d3e-b38ed2a6be90 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:41.702477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65262b13-81cf-48d1-9d3e-b38ed2a6be90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:41.719447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-65262b13-81cf-48d1-9d3e-b38ed2a6be90 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:41.720624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-65262b13-81cf-48d1-9d3e-b38ed2a6be90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:41.738109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:41.787237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 551/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:41.810581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111cf55-5c6b-456a-b9fa-ec2f5407d075 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:41.910122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111cf55-5c6b-456a-b9fa-ec2f5407d075 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:41.943019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f625a48-535b-4d15-a08b-f3e0529abc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:41.943899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f625a48-535b-4d15-a08b-f3e0529abc15 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:41.944170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f625a48-535b-4d15-a08b-f3e0529abc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:41.944442 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f625a48-535b-4d15-a08b-f3e0529abc15 None admin] PATH_INFO: `/v3/roles/66b09c60197a4a1fb2cca5402bb83375` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:41.945877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f625a48-535b-4d15-a08b-f3e0529abc15 None admin] RBAC: Authorizing `identity:get_role(role_id=66b09c60197a4a1fb2cca5402bb83375)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:41.947266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f625a48-535b-4d15-a08b-f3e0529abc15 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:41.948607 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 562/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:41 2022] GET /identity/v3/roles/66b09c60197a4a1fb2cca5402bb83375 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:41.954265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65262b13-81cf-48d1-9d3e-b38ed2a6be90 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:42.049827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65262b13-81cf-48d1-9d3e-b38ed2a6be90 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:42.082917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd021f-87c0-4fab-a72f-f05aedc42f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:42.083782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd021f-87c0-4fab-a72f-f05aedc42f88 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:42.084066 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd021f-87c0-4fab-a72f-f05aedc42f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:42.084339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd021f-87c0-4fab-a72f-f05aedc42f88 None admin] PATH_INFO: `/v3/users/ac613dac45c745de8247e9cc6acdf7a8` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:42.096997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd021f-87c0-4fab-a72f-f05aedc42f88 None admin] RBAC: Authorizing `identity:get_user(user_id=ac613dac45c745de8247e9cc6acdf7a8)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:42.098436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd021f-87c0-4fab-a72f-f05aedc42f88 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:42.100595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 552/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:41 2022] GET /identity/v3/users/ac613dac45c745de8247e9cc6acdf7a8 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:42.106407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f625a48-535b-4d15-a08b-f3e0529abc15 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:42.117780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:42.204289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f625a48-535b-4d15-a08b-f3e0529abc15 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:42.236491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38c83-f3a7-4557-98dd-1706747e8710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:42.237116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38c83-f3a7-4557-98dd-1706747e8710 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:42.237393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38c83-f3a7-4557-98dd-1706747e8710 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:42.237659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38c83-f3a7-4557-98dd-1706747e8710 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:42.304741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c38c83-f3a7-4557-98dd-1706747e8710 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:42.306106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c38c83-f3a7-4557-98dd-1706747e8710 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:42.315691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:42.401865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 563/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:55:42.407734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd021f-87c0-4fab-a72f-f05aedc42f88 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:42.422875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:42.505793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd021f-87c0-4fab-a72f-f05aedc42f88 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:42.540747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5da877-0055-4a5b-a42b-4f33c9c1423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:42.541592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5da877-0055-4a5b-a42b-4f33c9c1423e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:42.541870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5da877-0055-4a5b-a42b-4f33c9c1423e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:42.542141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5da877-0055-4a5b-a42b-4f33c9c1423e None admin] PATH_INFO: `/v3/projects/568ecd6d78604253958a9d0136bab9fb` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:42.543310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5da877-0055-4a5b-a42b-4f33c9c1423e None admin] RBAC: Authorizing `identity:get_project(project_id=568ecd6d78604253958a9d0136bab9fb)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:42.544726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5da877-0055-4a5b-a42b-4f33c9c1423e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:42.546384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 553/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:55:42 2022] GET /identity/v3/projects/568ecd6d78604253958a9d0136bab9fb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:42.552428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38c83-f3a7-4557-98dd-1706747e8710 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:42.648931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38c83-f3a7-4557-98dd-1706747e8710 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:42.657612 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:42.681268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990aeadf-7c32-4ff6-8bea-0186aac07180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:42.681908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aeadf-7c32-4ff6-8bea-0186aac07180 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:42.682188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aeadf-7c32-4ff6-8bea-0186aac07180 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:42.682463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aeadf-7c32-4ff6-8bea-0186aac07180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:42.683306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990aeadf-7c32-4ff6-8bea-0186aac07180 None admin] RBAC: Adding query filter params (role.id=66b09c60197a4a1fb2cca5402bb83375, scope.project.id=568ecd6d78604253958a9d0136bab9fb, user.id=ac613dac45c745de8247e9cc6acdf7a8) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:42.683617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990aeadf-7c32-4ff6-8bea-0186aac07180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:42.685023 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990aeadf-7c32-4ff6-8bea-0186aac07180 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:42.690422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 564/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:42 2022] GET /identity/v3/role_assignments?user.id=ac613dac45c745de8247e9cc6acdf7a8&scope.project.id=568ecd6d78604253958a9d0136bab9fb&role.id=66b09c60197a4a1fb2cca5402bb83375 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:44.837500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffd304-ec77-4ab6-9fd7-db29b6736a26 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:44.837998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffd304-ec77-4ab6-9fd7-db29b6736a26 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:44.837998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffd304-ec77-4ab6-9fd7-db29b6736a26 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:44.839349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 554/1118] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:55:44.844472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ea3e-8bfa-4a2d-b339-7a78b9dd8a03 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:44.844889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ea3e-8bfa-4a2d-b339-7a78b9dd8a03 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:44.845064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ea3e-8bfa-4a2d-b339-7a78b9dd8a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:44.862048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f916ea3e-8bfa-4a2d-b339-7a78b9dd8a03 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:44.863258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f916ea3e-8bfa-4a2d-b339-7a78b9dd8a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:44.927881 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 565/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:55:44.950649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffd304-ec77-4ab6-9fd7-db29b6736a26 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:45.031298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:45.050666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffd304-ec77-4ab6-9fd7-db29b6736a26 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:45.083644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eedc29-b61f-48e9-9408-4dcf4849441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:45.084708 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eedc29-b61f-48e9-9408-4dcf4849441e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:45.085159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eedc29-b61f-48e9-9408-4dcf4849441e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:45.085445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eedc29-b61f-48e9-9408-4dcf4849441e None admin] PATH_INFO: `/v3/roles/66b09c60197a4a1fb2cca5402bb83375` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:45.086934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eedc29-b61f-48e9-9408-4dcf4849441e None admin] RBAC: Authorizing `identity:get_role(role_id=66b09c60197a4a1fb2cca5402bb83375)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:45.088353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eedc29-b61f-48e9-9408-4dcf4849441e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:45.089644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 555/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:44 2022] GET /identity/v3/roles/66b09c60197a4a1fb2cca5402bb83375 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:45.095529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916ea3e-8bfa-4a2d-b339-7a78b9dd8a03 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:45.191267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916ea3e-8bfa-4a2d-b339-7a78b9dd8a03 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:45.192736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:45.225597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52895b-09f6-43c1-bb3c-d65531d1cd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:45.226446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52895b-09f6-43c1-bb3c-d65531d1cd8d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:45.226745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52895b-09f6-43c1-bb3c-d65531d1cd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:45.227022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52895b-09f6-43c1-bb3c-d65531d1cd8d None admin] PATH_INFO: `/v3/users/ac613dac45c745de8247e9cc6acdf7a8` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:45.228196 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52895b-09f6-43c1-bb3c-d65531d1cd8d None admin] RBAC: Authorizing `identity:get_user(user_id=ac613dac45c745de8247e9cc6acdf7a8)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:45.229614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52895b-09f6-43c1-bb3c-d65531d1cd8d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:45.231251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 566/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:45 2022] GET /identity/v3/users/ac613dac45c745de8247e9cc6acdf7a8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:45.236911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eedc29-b61f-48e9-9408-4dcf4849441e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:45.333831 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eedc29-b61f-48e9-9408-4dcf4849441e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:45.368164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9369ef6-5a74-4665-b571-327731a91f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:45.368943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369ef6-5a74-4665-b571-327731a91f36 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:45.369227 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369ef6-5a74-4665-b571-327731a91f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:45.369502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9369ef6-5a74-4665-b571-327731a91f36 None admin] PATH_INFO: `/v3/projects/568ecd6d78604253958a9d0136bab9fb` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:45.370666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9369ef6-5a74-4665-b571-327731a91f36 None admin] RBAC: Authorizing `identity:get_project(project_id=568ecd6d78604253958a9d0136bab9fb)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:45.372121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9369ef6-5a74-4665-b571-327731a91f36 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:45.373770 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 556/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:55:45 2022] GET /identity/v3/projects/568ecd6d78604253958a9d0136bab9fb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:45.379587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52895b-09f6-43c1-bb3c-d65531d1cd8d None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:45.480269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52895b-09f6-43c1-bb3c-d65531d1cd8d None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:45.514498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff4a45-b828-4a87-a861-a7e9824d7882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:45.515403 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff4a45-b828-4a87-a861-a7e9824d7882 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:45.515689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff4a45-b828-4a87-a861-a7e9824d7882 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:45.515964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff4a45-b828-4a87-a861-a7e9824d7882 None admin] PATH_INFO: `/v3/projects/568ecd6d78604253958a9d0136bab9fb/users/ac613dac45c745de8247e9cc6acdf7a8/roles/66b09c60197a4a1fb2cca5402bb83375` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:45.518162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff4a45-b828-4a87-a861-a7e9824d7882 None admin] RBAC: Authorizing `identity:create_grant(project_id=568ecd6d78604253958a9d0136bab9fb, user_id=ac613dac45c745de8247e9cc6acdf7a8, role_id=66b09c60197a4a1fb2cca5402bb83375)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:45.519637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff4a45-b828-4a87-a861-a7e9824d7882 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:45.532114 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 567/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:55:45 2022] PUT /identity/v3/projects/568ecd6d78604253958a9d0136bab9fb/users/ac613dac45c745de8247e9cc6acdf7a8/roles/66b09c60197a4a1fb2cca5402bb83375 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:55:47.690938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df87a-20af-4810-947f-4b019808e42d None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:47.691447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df87a-20af-4810-947f-4b019808e42d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:47.691559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2df87a-20af-4810-947f-4b019808e42d None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:47.692863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 557/1124] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:47.698570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa4543-7313-4aa3-9e97-568223985957 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:47.699017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa4543-7313-4aa3-9e97-568223985957 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:47.699146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa4543-7313-4aa3-9e97-568223985957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:47.715165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f1aa4543-7313-4aa3-9e97-568223985957 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:47.716370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f1aa4543-7313-4aa3-9e97-568223985957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:47.739352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:47.783359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 568/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:47.807362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2df87a-20af-4810-947f-4b019808e42d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:47.826191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:47.907255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2df87a-20af-4810-947f-4b019808e42d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:47.940427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246fbad-3168-4f4d-88b4-95c202c0bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:47.941258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246fbad-3168-4f4d-88b4-95c202c0bd94 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:47.941537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246fbad-3168-4f4d-88b4-95c202c0bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:47.941810 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246fbad-3168-4f4d-88b4-95c202c0bd94 None admin] PATH_INFO: `/v3/roles/66b09c60197a4a1fb2cca5402bb83375` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:47.943265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246fbad-3168-4f4d-88b4-95c202c0bd94 None admin] RBAC: Authorizing `identity:get_role(role_id=66b09c60197a4a1fb2cca5402bb83375)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:47.944770 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246fbad-3168-4f4d-88b4-95c202c0bd94 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:47.946085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 558/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:47 2022] GET /identity/v3/roles/66b09c60197a4a1fb2cca5402bb83375 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:47.951798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa4543-7313-4aa3-9e97-568223985957 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:48.048738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa4543-7313-4aa3-9e97-568223985957 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:48.080764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890fec-3030-40a8-8bba-e0a017d30cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:48.081613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890fec-3030-40a8-8bba-e0a017d30cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:48.081895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890fec-3030-40a8-8bba-e0a017d30cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:48.082168 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890fec-3030-40a8-8bba-e0a017d30cf9 None admin] PATH_INFO: `/v3/users/ac613dac45c745de8247e9cc6acdf7a8` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:48.083333 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e890fec-3030-40a8-8bba-e0a017d30cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=ac613dac45c745de8247e9cc6acdf7a8)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:48.084800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e890fec-3030-40a8-8bba-e0a017d30cf9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:48.086389 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 569/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:47 2022] GET /identity/v3/users/ac613dac45c745de8247e9cc6acdf7a8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:48.091891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246fbad-3168-4f4d-88b4-95c202c0bd94 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:48.172898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:48.188721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246fbad-3168-4f4d-88b4-95c202c0bd94 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:48.220624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a2835-9022-4f01-b9ea-0c296a0419a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:48.221255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a2835-9022-4f01-b9ea-0c296a0419a3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:48.221539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a2835-9022-4f01-b9ea-0c296a0419a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:48.221815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a2835-9022-4f01-b9ea-0c296a0419a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:48.286506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a2835-9022-4f01-b9ea-0c296a0419a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:48.288564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a2835-9022-4f01-b9ea-0c296a0419a3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:48.368606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:48.385794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 559/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:55:48.391742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890fec-3030-40a8-8bba-e0a017d30cf9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:48.419211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:48.488503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890fec-3030-40a8-8bba-e0a017d30cf9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:48.522625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efe2b1-5756-4c08-8787-b3c513c307ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:48.523503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efe2b1-5756-4c08-8787-b3c513c307ac None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:48.523784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efe2b1-5756-4c08-8787-b3c513c307ac None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:48.524055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efe2b1-5756-4c08-8787-b3c513c307ac None admin] PATH_INFO: `/v3/projects/568ecd6d78604253958a9d0136bab9fb` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:48.525226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efe2b1-5756-4c08-8787-b3c513c307ac None admin] RBAC: Authorizing `identity:get_project(project_id=568ecd6d78604253958a9d0136bab9fb)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:48.526640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efe2b1-5756-4c08-8787-b3c513c307ac None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:48.528348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 570/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:55:48 2022] GET /identity/v3/projects/568ecd6d78604253958a9d0136bab9fb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:48.534411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a2835-9022-4f01-b9ea-0c296a0419a3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:48.635081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a2835-9022-4f01-b9ea-0c296a0419a3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:48.675628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b20f1-1815-4132-a668-8e6b0abb3c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:48.676591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b20f1-1815-4132-a668-8e6b0abb3c16 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:48.677035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b20f1-1815-4132-a668-8e6b0abb3c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:48.677340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b20f1-1815-4132-a668-8e6b0abb3c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:48.678829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b20f1-1815-4132-a668-8e6b0abb3c16 None admin] RBAC: Adding query filter params (role.id=66b09c60197a4a1fb2cca5402bb83375, scope.project.id=568ecd6d78604253958a9d0136bab9fb, user.id=ac613dac45c745de8247e9cc6acdf7a8) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:48.679146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b20f1-1815-4132-a668-8e6b0abb3c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:48.680581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b20f1-1815-4132-a668-8e6b0abb3c16 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:48.686368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 560/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:48 2022] GET /identity/v3/role_assignments?user.id=ac613dac45c745de8247e9cc6acdf7a8&scope.project.id=568ecd6d78604253958a9d0136bab9fb&role.id=66b09c60197a4a1fb2cca5402bb83375 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:50.896084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e7a4-5085-48d8-8a07-dff78b02cc3a None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:50.896592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e7a4-5085-48d8-8a07-dff78b02cc3a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:50.896752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e7a4-5085-48d8-8a07-dff78b02cc3a None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:50.898133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 571/1131] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:50.903205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d9c09-7615-4e71-af9f-d6758453131a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:50.903570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d9c09-7615-4e71-af9f-d6758453131a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:50.903756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d9c09-7615-4e71-af9f-d6758453131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:50.920544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-142d9c09-7615-4e71-af9f-d6758453131a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:50.921710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-142d9c09-7615-4e71-af9f-d6758453131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:50.963458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:50.988840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 561/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:51.012412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e7a4-5085-48d8-8a07-dff78b02cc3a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:51.105320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:51.112179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e7a4-5085-48d8-8a07-dff78b02cc3a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:51.144807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ec19b-d8fe-414a-924f-39d92be22e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:51.145574 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ec19b-d8fe-414a-924f-39d92be22e77 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:51.145853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ec19b-d8fe-414a-924f-39d92be22e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:51.146175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ec19b-d8fe-414a-924f-39d92be22e77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:51.147509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ec19b-d8fe-414a-924f-39d92be22e77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:51.148920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ec19b-d8fe-414a-924f-39d92be22e77 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:51.150505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 572/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:51.156204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d9c09-7615-4e71-af9f-d6758453131a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:51.251699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d9c09-7615-4e71-af9f-d6758453131a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:51.284074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1fa54-b293-4bd1-808b-bebafe5ed5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:51.284714 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1fa54-b293-4bd1-808b-bebafe5ed5e9 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:51.284994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1fa54-b293-4bd1-808b-bebafe5ed5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:51.285270 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1fa54-b293-4bd1-808b-bebafe5ed5e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:51.285959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1fa54-b293-4bd1-808b-bebafe5ed5e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:51.287953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1fa54-b293-4bd1-808b-bebafe5ed5e9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:51.311936 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 562/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:55:51 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:55:53.529566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58872a-288d-4e56-929e-43176e5a9c50 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:53.530034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58872a-288d-4e56-929e-43176e5a9c50 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:53.530133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58872a-288d-4e56-929e-43176e5a9c50 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:53.531501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 573/1135] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:53.536663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987545c9-b121-448f-948f-7671006c5812 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:53.537681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987545c9-b121-448f-948f-7671006c5812 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:53.537822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987545c9-b121-448f-948f-7671006c5812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:53.554147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-987545c9-b121-448f-948f-7671006c5812 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:53.555354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-987545c9-b121-448f-948f-7671006c5812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:53.577954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:53.620888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 563/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:53.645477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58872a-288d-4e56-929e-43176e5a9c50 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:53.789167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58872a-288d-4e56-929e-43176e5a9c50 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:53.822904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568071e0-13cb-4912-8a81-49b5fc915677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:53.823715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568071e0-13cb-4912-8a81-49b5fc915677 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:53.824003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568071e0-13cb-4912-8a81-49b5fc915677 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:53.824298 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568071e0-13cb-4912-8a81-49b5fc915677 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:53.825497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568071e0-13cb-4912-8a81-49b5fc915677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:53.827011 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568071e0-13cb-4912-8a81-49b5fc915677 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:53.828691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 574/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:53.835076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987545c9-b121-448f-948f-7671006c5812 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:53.931692 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987545c9-b121-448f-948f-7671006c5812 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:53.964866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0e0a0-d812-46a4-958b-393fbe626fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:53.965539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0e0a0-d812-46a4-958b-393fbe626fe0 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:53.965825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0e0a0-d812-46a4-958b-393fbe626fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:53.966101 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0e0a0-d812-46a4-958b-393fbe626fe0 None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:53.966835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0e0a0-d812-46a4-958b-393fbe626fe0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:53.968274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0e0a0-d812-46a4-958b-393fbe626fe0 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:53.989034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 564/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:55:53 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:55:56.204345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf401c-0693-4d59-b683-055ece3b977a None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:56.204906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf401c-0693-4d59-b683-055ece3b977a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:56.204906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf401c-0693-4d59-b683-055ece3b977a None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:56.206270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 575/1139] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:56.211514 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b60ea4-8d3d-48a5-ab86-06c742d94fba None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:56.211928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b60ea4-8d3d-48a5-ab86-06c742d94fba None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:56.212076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b60ea4-8d3d-48a5-ab86-06c742d94fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:56.229245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e4b60ea4-8d3d-48a5-ab86-06c742d94fba None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:56.230427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e4b60ea4-8d3d-48a5-ab86-06c742d94fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:56.241540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:56.297254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 565/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:56.321046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf401c-0693-4d59-b683-055ece3b977a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:56.352148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:56.421064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf401c-0693-4d59-b683-055ece3b977a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:56.453766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa31e98-8bd6-41ac-87f7-00971e12c5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:56.454588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa31e98-8bd6-41ac-87f7-00971e12c5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:56.454845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa31e98-8bd6-41ac-87f7-00971e12c5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:56.455120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa31e98-8bd6-41ac-87f7-00971e12c5b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:56.466543 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa31e98-8bd6-41ac-87f7-00971e12c5b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-bfa31e98-8bd6-41ac-87f7-00971e12c5b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:56.474078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:56.475579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:56.476434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 576/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:55:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:56.481261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b60ea4-8d3d-48a5-ab86-06c742d94fba None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:56.578537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b60ea4-8d3d-48a5-ab86-06c742d94fba None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:56.610836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed6122-4821-47dc-9e4d-ca2747cfc3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:56.611502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed6122-4821-47dc-9e4d-ca2747cfc3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:56.611791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed6122-4821-47dc-9e4d-ca2747cfc3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:56.612061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed6122-4821-47dc-9e4d-ca2747cfc3c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:56.612799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed6122-4821-47dc-9e4d-ca2747cfc3c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:56.613105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed6122-4821-47dc-9e4d-ca2747cfc3c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:56.614462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed6122-4821-47dc-9e4d-ca2747cfc3c5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:56.623109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 566/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:56.628824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa31e98-8bd6-41ac-87f7-00971e12c5b8 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:56.716691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:56.725893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa31e98-8bd6-41ac-87f7-00971e12c5b8 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:56.759731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd75055-c31d-484f-8876-507307a40701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:56.760580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75055-c31d-484f-8876-507307a40701 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:56.760856 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75055-c31d-484f-8876-507307a40701 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:56.761126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75055-c31d-484f-8876-507307a40701 None admin] PATH_INFO: `/v3/users/a4f955c63eab42a28ccc409cd663ea65` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:56.774507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd75055-c31d-484f-8876-507307a40701 None admin] RBAC: Authorizing `identity:get_user(user_id=a4f955c63eab42a28ccc409cd663ea65)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:56.776058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd75055-c31d-484f-8876-507307a40701 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:56.777636 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 577/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:56 2022] GET /identity/v3/users/a4f955c63eab42a28ccc409cd663ea65 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:56.783454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed6122-4821-47dc-9e4d-ca2747cfc3c5 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:56.794545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:56.889174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed6122-4821-47dc-9e4d-ca2747cfc3c5 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:56.922109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5f3e2-bd71-4484-a806-1a43a6e4b408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:56.922781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5f3e2-bd71-4484-a806-1a43a6e4b408 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:56.923071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5f3e2-bd71-4484-a806-1a43a6e4b408 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:56.923351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5f3e2-bd71-4484-a806-1a43a6e4b408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:56.989118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5f3e2-bd71-4484-a806-1a43a6e4b408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:56.991159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5f3e2-bd71-4484-a806-1a43a6e4b408 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:57.000299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:57.086126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 567/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:55:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:55:57.092008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd75055-c31d-484f-8876-507307a40701 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:57.189315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd75055-c31d-484f-8876-507307a40701 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:57.221790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52bf26-8e98-4021-ba64-e8dd52b8d628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:57.222635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52bf26-8e98-4021-ba64-e8dd52b8d628 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:57.222941 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52bf26-8e98-4021-ba64-e8dd52b8d628 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:57.223209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52bf26-8e98-4021-ba64-e8dd52b8d628 None admin] PATH_INFO: `/v3/projects/23c7a0293ae246af930fe30e7965c6a7` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:57.224944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52bf26-8e98-4021-ba64-e8dd52b8d628 None admin] RBAC: Authorizing `identity:get_project(project_id=23c7a0293ae246af930fe30e7965c6a7)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:57.226354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52bf26-8e98-4021-ba64-e8dd52b8d628 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:57.228099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 578/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:55:57 2022] GET /identity/v3/projects/23c7a0293ae246af930fe30e7965c6a7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:57.234007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5f3e2-bd71-4484-a806-1a43a6e4b408 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:57.329360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5f3e2-bd71-4484-a806-1a43a6e4b408 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:57.338923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:57.363256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e46ff-c620-430b-b0c5-c81c10bbe0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:57.363894 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e46ff-c620-430b-b0c5-c81c10bbe0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:57.364176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e46ff-c620-430b-b0c5-c81c10bbe0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:57.364450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e46ff-c620-430b-b0c5-c81c10bbe0d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:57.365808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e46ff-c620-430b-b0c5-c81c10bbe0d8 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=23c7a0293ae246af930fe30e7965c6a7, user.id=a4f955c63eab42a28ccc409cd663ea65) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:57.366114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e46ff-c620-430b-b0c5-c81c10bbe0d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:57.367555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e46ff-c620-430b-b0c5-c81c10bbe0d8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:57.372853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 568/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:55:57 2022] GET /identity/v3/role_assignments?user.id=a4f955c63eab42a28ccc409cd663ea65&scope.project.id=23c7a0293ae246af930fe30e7965c6a7&role.id=af8084c48e3c40298e26d44d6d14595a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:59.539418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7369d6-3a1e-4574-b65b-829012fd56c2 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:59.539871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7369d6-3a1e-4574-b65b-829012fd56c2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:59.539978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7369d6-3a1e-4574-b65b-829012fd56c2 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:59.541325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 579/1147] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:55:59.546571 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771f382-2f70-4cd3-84e7-8eeb73ea09aa None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:59.546999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771f382-2f70-4cd3-84e7-8eeb73ea09aa None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:59.547158 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771f382-2f70-4cd3-84e7-8eeb73ea09aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:59.563453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b771f382-2f70-4cd3-84e7-8eeb73ea09aa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:55:59.564620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b771f382-2f70-4cd3-84e7-8eeb73ea09aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:55:59.628941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 569/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:55:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:55:59.651647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7369d6-3a1e-4574-b65b-829012fd56c2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:59.670509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:59.753121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7369d6-3a1e-4574-b65b-829012fd56c2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:59.786154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f5697-bbc9-4c7d-a0d6-62c3fd5aa69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:59.787461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f5697-bbc9-4c7d-a0d6-62c3fd5aa69f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:59.787741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f5697-bbc9-4c7d-a0d6-62c3fd5aa69f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:59.788015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f5697-bbc9-4c7d-a0d6-62c3fd5aa69f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:59.797707 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f5697-bbc9-4c7d-a0d6-62c3fd5aa69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-495f5697-bbc9-4c7d-a0d6-62c3fd5aa69f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:55:59.805349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:55:59.806443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:55:59.807695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 580/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:55:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:55:59.812596 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771f382-2f70-4cd3-84e7-8eeb73ea09aa None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:55:59.908064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771f382-2f70-4cd3-84e7-8eeb73ea09aa None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:55:59.909595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:55:59.943248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02bb44-f0a1-4edc-a6c4-752a7b3a3923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:55:59.943965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02bb44-f0a1-4edc-a6c4-752a7b3a3923 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:55:59.944247 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02bb44-f0a1-4edc-a6c4-752a7b3a3923 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:55:59.944525 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02bb44-f0a1-4edc-a6c4-752a7b3a3923 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:55:59.945268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02bb44-f0a1-4edc-a6c4-752a7b3a3923 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:55:59.945574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02bb44-f0a1-4edc-a6c4-752a7b3a3923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:55:59.946967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02bb44-f0a1-4edc-a6c4-752a7b3a3923 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:55:59.955127 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 570/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:55:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:55:59.961012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f5697-bbc9-4c7d-a0d6-62c3fd5aa69f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:00.047049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:00.068624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f5697-bbc9-4c7d-a0d6-62c3fd5aa69f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:00.102018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff53f9-694a-4850-a80c-b54d68a5bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:00.102916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff53f9-694a-4850-a80c-b54d68a5bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:00.103200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff53f9-694a-4850-a80c-b54d68a5bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:00.103473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff53f9-694a-4850-a80c-b54d68a5bcd9 None admin] PATH_INFO: `/v3/users/a4f955c63eab42a28ccc409cd663ea65` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:00.104640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff53f9-694a-4850-a80c-b54d68a5bcd9 None admin] RBAC: Authorizing `identity:get_user(user_id=a4f955c63eab42a28ccc409cd663ea65)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:00.106064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff53f9-694a-4850-a80c-b54d68a5bcd9 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:00.107722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 581/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:55:59 2022] GET /identity/v3/users/a4f955c63eab42a28ccc409cd663ea65 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:00.113429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02bb44-f0a1-4edc-a6c4-752a7b3a3923 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:00.214533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02bb44-f0a1-4edc-a6c4-752a7b3a3923 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:00.249625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677eb2-46df-48ca-8f76-bc7a98e69579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:00.250472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677eb2-46df-48ca-8f76-bc7a98e69579 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:00.250779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677eb2-46df-48ca-8f76-bc7a98e69579 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:00.251056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677eb2-46df-48ca-8f76-bc7a98e69579 None admin] PATH_INFO: `/v3/projects/23c7a0293ae246af930fe30e7965c6a7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:00.252203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677eb2-46df-48ca-8f76-bc7a98e69579 None admin] RBAC: Authorizing `identity:get_project(project_id=23c7a0293ae246af930fe30e7965c6a7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:00.253628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677eb2-46df-48ca-8f76-bc7a98e69579 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:00.255356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 571/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:56:00 2022] GET /identity/v3/projects/23c7a0293ae246af930fe30e7965c6a7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:00.261714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff53f9-694a-4850-a80c-b54d68a5bcd9 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:00.359225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff53f9-694a-4850-a80c-b54d68a5bcd9 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:00.391085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbdb0b-007f-4762-afb6-36ffeb6a1827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:00.391945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbdb0b-007f-4762-afb6-36ffeb6a1827 None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:00.392222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbdb0b-007f-4762-afb6-36ffeb6a1827 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:00.392491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbdb0b-007f-4762-afb6-36ffeb6a1827 None admin] PATH_INFO: `/v3/projects/23c7a0293ae246af930fe30e7965c6a7/users/a4f955c63eab42a28ccc409cd663ea65/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:00.394389 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbdb0b-007f-4762-afb6-36ffeb6a1827 None admin] RBAC: Authorizing `identity:create_grant(project_id=23c7a0293ae246af930fe30e7965c6a7, user_id=a4f955c63eab42a28ccc409cd663ea65, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:00.395829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbdb0b-007f-4762-afb6-36ffeb6a1827 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:00.408935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 582/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:56:00 2022] PUT /identity/v3/projects/23c7a0293ae246af930fe30e7965c6a7/users/a4f955c63eab42a28ccc409cd663ea65/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:56:02.577184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6afaa-23a3-4f34-ae73-057508be4f72 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:02.577694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6afaa-23a3-4f34-ae73-057508be4f72 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:02.577795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6afaa-23a3-4f34-ae73-057508be4f72 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:02.579134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 572/1154] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:56:02.584776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a044ba0-0513-49a3-a3df-a0029e83f4be None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:02.585206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a044ba0-0513-49a3-a3df-a0029e83f4be None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:02.585391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a044ba0-0513-49a3-a3df-a0029e83f4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:02.597322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:02.603783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4a044ba0-0513-49a3-a3df-a0029e83f4be None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:56:02.605431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4a044ba0-0513-49a3-a3df-a0029e83f4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:56:02.670254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 583/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:56:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:56:02.695143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6afaa-23a3-4f34-ae73-057508be4f72 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:02.727683 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:02.797828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6afaa-23a3-4f34-ae73-057508be4f72 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:02.829619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d3ef0-e948-4f7a-b5bd-733f32a5fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:02.830392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d3ef0-e948-4f7a-b5bd-733f32a5fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:02.830671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d3ef0-e948-4f7a-b5bd-733f32a5fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:02.830973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d3ef0-e948-4f7a-b5bd-733f32a5fbf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:02.841549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d3ef0-e948-4f7a-b5bd-733f32a5fbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-9e3d3ef0-e948-4f7a-b5bd-733f32a5fbf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:56:02.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:56:02.851183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:56:02.852297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 573/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:56:02.857345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a044ba0-0513-49a3-a3df-a0029e83f4be None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:02.952627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a044ba0-0513-49a3-a3df-a0029e83f4be None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:02.984990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e480f-e56e-4d68-ba67-9b749d6661ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:02.985631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e480f-e56e-4d68-ba67-9b749d6661ec None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:02.985911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e480f-e56e-4d68-ba67-9b749d6661ec None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:02.986183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e480f-e56e-4d68-ba67-9b749d6661ec None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:02.986950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e480f-e56e-4d68-ba67-9b749d6661ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:56:02.987250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e480f-e56e-4d68-ba67-9b749d6661ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:02.988593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e480f-e56e-4d68-ba67-9b749d6661ec None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:02.990942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:02.997579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 584/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:56:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:03.003311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d3ef0-e948-4f7a-b5bd-733f32a5fbf1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:03.092598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:03.101689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d3ef0-e948-4f7a-b5bd-733f32a5fbf1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:03.135569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22e359-738c-4c19-a882-06843377934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:03.136418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22e359-738c-4c19-a882-06843377934e None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:03.136706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22e359-738c-4c19-a882-06843377934e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:03.136981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22e359-738c-4c19-a882-06843377934e None admin] PATH_INFO: `/v3/users/a4f955c63eab42a28ccc409cd663ea65` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:03.138142 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22e359-738c-4c19-a882-06843377934e None admin] RBAC: Authorizing `identity:get_user(user_id=a4f955c63eab42a28ccc409cd663ea65)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:03.139666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22e359-738c-4c19-a882-06843377934e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:03.141261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 574/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:56:03 2022] GET /identity/v3/users/a4f955c63eab42a28ccc409cd663ea65 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:03.147559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e480f-e56e-4d68-ba67-9b749d6661ec None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:03.243976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e480f-e56e-4d68-ba67-9b749d6661ec None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:03.276946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b397028-3924-4eab-8803-9ac5d973fc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:03.277572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b397028-3924-4eab-8803-9ac5d973fc58 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:03.277854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b397028-3924-4eab-8803-9ac5d973fc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:03.278129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b397028-3924-4eab-8803-9ac5d973fc58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:03.341033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:03.344925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b397028-3924-4eab-8803-9ac5d973fc58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:03.346301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b397028-3924-4eab-8803-9ac5d973fc58 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:03.440863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 585/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:56:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:56:03.447283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22e359-738c-4c19-a882-06843377934e None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:03.542781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22e359-738c-4c19-a882-06843377934e None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:03.576171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9aa83-4c94-4a4a-939d-913a421c5ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:03.577011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9aa83-4c94-4a4a-939d-913a421c5ace None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:03.577293 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9aa83-4c94-4a4a-939d-913a421c5ace None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:03.577819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9aa83-4c94-4a4a-939d-913a421c5ace None admin] PATH_INFO: `/v3/projects/23c7a0293ae246af930fe30e7965c6a7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:03.578734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9aa83-4c94-4a4a-939d-913a421c5ace None admin] RBAC: Authorizing `identity:get_project(project_id=23c7a0293ae246af930fe30e7965c6a7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:03.580164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9aa83-4c94-4a4a-939d-913a421c5ace None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:03.581829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 575/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:56:03 2022] GET /identity/v3/projects/23c7a0293ae246af930fe30e7965c6a7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:03.587898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b397028-3924-4eab-8803-9ac5d973fc58 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:03.681180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:03.684817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b397028-3924-4eab-8803-9ac5d973fc58 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:03.723133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b42ed-1634-4dfa-83bd-bc9935f1d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:03.723779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b42ed-1634-4dfa-83bd-bc9935f1d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:03.726063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b42ed-1634-4dfa-83bd-bc9935f1d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:03.726340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b42ed-1634-4dfa-83bd-bc9935f1d6f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:03.727197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b42ed-1634-4dfa-83bd-bc9935f1d6f7 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=23c7a0293ae246af930fe30e7965c6a7, user.id=a4f955c63eab42a28ccc409cd663ea65) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:56:03.727513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b42ed-1634-4dfa-83bd-bc9935f1d6f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:03.729009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b42ed-1634-4dfa-83bd-bc9935f1d6f7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:03.735853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 586/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:56:03 2022] GET /identity/v3/role_assignments?user.id=a4f955c63eab42a28ccc409cd663ea65&scope.project.id=23c7a0293ae246af930fe30e7965c6a7&role.id=af8084c48e3c40298e26d44d6d14595a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:05.958401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b084c-48d9-44e1-822d-8642e88b36b5 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:05.958975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b084c-48d9-44e1-822d-8642e88b36b5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:05.958975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b084c-48d9-44e1-822d-8642e88b36b5 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:05.960346 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 576/1162] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:56:05.965454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970b5d-dfdf-45f1-a318-b005727a9358 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:05.965877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970b5d-dfdf-45f1-a318-b005727a9358 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:05.966015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970b5d-dfdf-45f1-a318-b005727a9358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:05.982929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7c970b5d-dfdf-45f1-a318-b005727a9358 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:56:05.984110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7c970b5d-dfdf-45f1-a318-b005727a9358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:56:06.049572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 587/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:56:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:56:06.072957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b084c-48d9-44e1-822d-8642e88b36b5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:06.100624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:06.172609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b084c-48d9-44e1-822d-8642e88b36b5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:06.205473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5475af-e14c-4296-9f65-f547d1e3d8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:06.206107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5475af-e14c-4296-9f65-f547d1e3d8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:06.206391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5475af-e14c-4296-9f65-f547d1e3d8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:06.206666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5475af-e14c-4296-9f65-f547d1e3d8b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:06.275163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5475af-e14c-4296-9f65-f547d1e3d8b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:06.276534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5475af-e14c-4296-9f65-f547d1e3d8b3 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:06.302888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:06.388545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 577/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:56:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:56:06.394557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c970b5d-dfdf-45f1-a318-b005727a9358 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:06.483165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:06.492436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c970b5d-dfdf-45f1-a318-b005727a9358 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:06.526630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0944d3-ddf9-44cf-808c-3a924b9f006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:06.527398 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0944d3-ddf9-44cf-808c-3a924b9f006c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:06.527676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0944d3-ddf9-44cf-808c-3a924b9f006c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:06.527945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0944d3-ddf9-44cf-808c-3a924b9f006c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:06.534426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0944d3-ddf9-44cf-808c-3a924b9f006c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:06.535903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0944d3-ddf9-44cf-808c-3a924b9f006c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-6d0944d3-ddf9-44cf-808c-3a924b9f006c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:56:06.550301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:56:06.551534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:56:06.552619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 588/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Mon May 23 17:56:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:56:06.557393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5475af-e14c-4296-9f65-f547d1e3d8b3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:06.654018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5475af-e14c-4296-9f65-f547d1e3d8b3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:06.679870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:06.687658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be27275-3508-4f11-b5a9-5979ade470d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:06.688309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27275-3508-4f11-b5a9-5979ade470d4 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:06.688593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27275-3508-4f11-b5a9-5979ade470d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:06.688867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27275-3508-4f11-b5a9-5979ade470d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:06.689580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be27275-3508-4f11-b5a9-5979ade470d4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:56:06.689885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be27275-3508-4f11-b5a9-5979ade470d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:06.691287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be27275-3508-4f11-b5a9-5979ade470d4 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:06.699359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 578/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Mon May 23 17:56:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:08.850970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af487-6f75-4b07-a319-e1f0e3bbeccd None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:08.851500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af487-6f75-4b07-a319-e1f0e3bbeccd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:08.851500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af487-6f75-4b07-a319-e1f0e3bbeccd None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:08.852803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 589/1167] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 17:56:08.858122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9debfb-40dd-49d0-9182-9e269e1ffb44 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:08.858513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9debfb-40dd-49d0-9182-9e269e1ffb44 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:08.858737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9debfb-40dd-49d0-9182-9e269e1ffb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:08.875099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ae9debfb-40dd-49d0-9182-9e269e1ffb44 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:56:08.876271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ae9debfb-40dd-49d0-9182-9e269e1ffb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:56:08.940484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 579/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:56:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:56:08.963386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af487-6f75-4b07-a319-e1f0e3bbeccd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:09.061796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af487-6f75-4b07-a319-e1f0e3bbeccd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:09.094197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da730cd-1573-4efb-a248-57a4d97c391f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:09.094868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da730cd-1573-4efb-a248-57a4d97c391f None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:09.095151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da730cd-1573-4efb-a248-57a4d97c391f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:09.095452 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da730cd-1573-4efb-a248-57a4d97c391f None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:09.096189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da730cd-1573-4efb-a248-57a4d97c391f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:09.097536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da730cd-1573-4efb-a248-57a4d97c391f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:09.111386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 590/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Mon May 23 17:56:08 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:56:11.327069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73cde-9fca-4e18-ae3b-a7f84bc2ea40 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:11.327597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73cde-9fca-4e18-ae3b-a7f84bc2ea40 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:11.327690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73cde-9fca-4e18-ae3b-a7f84bc2ea40 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:11.329038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 580/1170] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:56:11.335001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72911491-75b3-4360-b9c3-1ffa82acf4f8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:11.335380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72911491-75b3-4360-b9c3-1ffa82acf4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:11.335555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72911491-75b3-4360-b9c3-1ffa82acf4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:11.351877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-72911491-75b3-4360-b9c3-1ffa82acf4f8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:56:11.353041 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-72911491-75b3-4360-b9c3-1ffa82acf4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:56:11.360043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:11.419599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 591/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:56:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:56:11.443289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba73cde-9fca-4e18-ae3b-a7f84bc2ea40 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:11.541846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba73cde-9fca-4e18-ae3b-a7f84bc2ea40 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:11.563719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:11.575570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366634c8-0c24-4d65-a3bd-5e0c76d2e9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:11.576417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366634c8-0c24-4d65-a3bd-5e0c76d2e9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:11.576697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366634c8-0c24-4d65-a3bd-5e0c76d2e9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:11.576970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366634c8-0c24-4d65-a3bd-5e0c76d2e9e5 None admin] PATH_INFO: `/v3/domains/9104eba4079b4fe9b6b6c1a4aaf7e071` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:11.587215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366634c8-0c24-4d65-a3bd-5e0c76d2e9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9104eba4079b4fe9b6b6c1a4aaf7e071)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:11.588587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366634c8-0c24-4d65-a3bd-5e0c76d2e9e5 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:11.590179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 581/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Mon May 23 17:56:11 2022] GET /identity/v3/domains/9104eba4079b4fe9b6b6c1a4aaf7e071 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:11.596017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72911491-75b3-4360-b9c3-1ffa82acf4f8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:11.690656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72911491-75b3-4360-b9c3-1ffa82acf4f8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:11.723256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93891845-6e32-42ed-8328-6faa392d1398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:11.723919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93891845-6e32-42ed-8328-6faa392d1398 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:11.724200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93891845-6e32-42ed-8328-6faa392d1398 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:11.724473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93891845-6e32-42ed-8328-6faa392d1398 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:11.725166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93891845-6e32-42ed-8328-6faa392d1398 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:11.726579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93891845-6e32-42ed-8328-6faa392d1398 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:11.739686 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:11.751589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 592/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:56:11 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:56:13.978008 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc99f76-4e4f-4b2c-ae5c-1041782c490e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:13.978549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc99f76-4e4f-4b2c-ae5c-1041782c490e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:13.978549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc99f76-4e4f-4b2c-ae5c-1041782c490e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:13.980105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 582/1174] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:56:13.985491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfcef-69b1-4fb6-947c-3686e63188a4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:13.985906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfcef-69b1-4fb6-947c-3686e63188a4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:13.986051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfcef-69b1-4fb6-947c-3686e63188a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:14.003351 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-542dfcef-69b1-4fb6-947c-3686e63188a4 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:56:14.004511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-542dfcef-69b1-4fb6-947c-3686e63188a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:56:14.069934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 593/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:56:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 17:56:14.094249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc99f76-4e4f-4b2c-ae5c-1041782c490e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:14.194680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc99f76-4e4f-4b2c-ae5c-1041782c490e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:14.228182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b094e-ae65-4ebe-9443-f5d7fb5c6891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:14.228974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b094e-ae65-4ebe-9443-f5d7fb5c6891 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:14.229256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b094e-ae65-4ebe-9443-f5d7fb5c6891 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:14.229530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b094e-ae65-4ebe-9443-f5d7fb5c6891 None admin] PATH_INFO: `/v3/domains/9104eba4079b4fe9b6b6c1a4aaf7e071` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:14.230683 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b094e-ae65-4ebe-9443-f5d7fb5c6891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9104eba4079b4fe9b6b6c1a4aaf7e071)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:14.232136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b094e-ae65-4ebe-9443-f5d7fb5c6891 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:14.233732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 583/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Mon May 23 17:56:14 2022] GET /identity/v3/domains/9104eba4079b4fe9b6b6c1a4aaf7e071 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:14.240067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dfcef-69b1-4fb6-947c-3686e63188a4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:14.334238 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dfcef-69b1-4fb6-947c-3686e63188a4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:14.357399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:14.369524 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067d0fa-26fa-4239-b155-1ba594b44299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:14.370182 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067d0fa-26fa-4239-b155-1ba594b44299 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:14.370465 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067d0fa-26fa-4239-b155-1ba594b44299 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:14.370770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067d0fa-26fa-4239-b155-1ba594b44299 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:14.371480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067d0fa-26fa-4239-b155-1ba594b44299 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:14.372908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067d0fa-26fa-4239-b155-1ba594b44299 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:14.392379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 594/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:56:14 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 17:56:16.646308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65278-c1ac-44ed-9c68-f2b114651679 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:16.646872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65278-c1ac-44ed-9c68-f2b114651679 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:16.646872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65278-c1ac-44ed-9c68-f2b114651679 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:16.648250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 584/1178] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:56:16.653504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22254ba2-6081-4f39-8f83-45b5349e62c8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:16.653933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22254ba2-6081-4f39-8f83-45b5349e62c8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:16.654065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22254ba2-6081-4f39-8f83-45b5349e62c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:16.670715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-22254ba2-6081-4f39-8f83-45b5349e62c8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:56:16.671882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-22254ba2-6081-4f39-8f83-45b5349e62c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:56:16.737663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 595/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:56:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:56:16.761514 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac65278-c1ac-44ed-9c68-f2b114651679 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:16.811552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:16.861552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac65278-c1ac-44ed-9c68-f2b114651679 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:16.894671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943bf63-d4b9-4e13-9569-a9f478278329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:16.895507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943bf63-d4b9-4e13-9569-a9f478278329 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:16.895789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943bf63-d4b9-4e13-9569-a9f478278329 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:16.896061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943bf63-d4b9-4e13-9569-a9f478278329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:16.906261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943bf63-d4b9-4e13-9569-a9f478278329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-0943bf63-d4b9-4e13-9569-a9f478278329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:56:16.914019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:56:16.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:56:16.916168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 585/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:56:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:56:16.921360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22254ba2-6081-4f39-8f83-45b5349e62c8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:17.015869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22254ba2-6081-4f39-8f83-45b5349e62c8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:17.026022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:17.055827 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289582a-5e1a-480c-8fed-6fca08ff0900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:17.056625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289582a-5e1a-480c-8fed-6fca08ff0900 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:17.057135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289582a-5e1a-480c-8fed-6fca08ff0900 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:17.057557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289582a-5e1a-480c-8fed-6fca08ff0900 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:17.058308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289582a-5e1a-480c-8fed-6fca08ff0900 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:56:17.058618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289582a-5e1a-480c-8fed-6fca08ff0900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:17.060028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289582a-5e1a-480c-8fed-6fca08ff0900 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:17.069060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 596/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:17.074787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943bf63-d4b9-4e13-9569-a9f478278329 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:17.171611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943bf63-d4b9-4e13-9569-a9f478278329 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:17.182709 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:17.205742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa73ce-bc42-4a9b-b7ad-8885a1863e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:17.206594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa73ce-bc42-4a9b-b7ad-8885a1863e81 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:17.206910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa73ce-bc42-4a9b-b7ad-8885a1863e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:17.207187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa73ce-bc42-4a9b-b7ad-8885a1863e81 None admin] PATH_INFO: `/v3/users/13fba1a9cd50487cab697722d39eeaae` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:17.221320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa73ce-bc42-4a9b-b7ad-8885a1863e81 None admin] RBAC: Authorizing `identity:get_user(user_id=13fba1a9cd50487cab697722d39eeaae)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:17.222802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa73ce-bc42-4a9b-b7ad-8885a1863e81 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:17.224960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 586/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:56:17 2022] GET /identity/v3/users/13fba1a9cd50487cab697722d39eeaae => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:17.230753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289582a-5e1a-480c-8fed-6fca08ff0900 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:17.328898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289582a-5e1a-480c-8fed-6fca08ff0900 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:17.361362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071bd2c-6724-42b9-bfbe-e6d2c8d505b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:17.361995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071bd2c-6724-42b9-bfbe-e6d2c8d505b4 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:17.362282 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071bd2c-6724-42b9-bfbe-e6d2c8d505b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:17.362559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071bd2c-6724-42b9-bfbe-e6d2c8d505b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:17.402493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:17.428965 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071bd2c-6724-42b9-bfbe-e6d2c8d505b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:17.430394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071bd2c-6724-42b9-bfbe-e6d2c8d505b4 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:17.525220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 597/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:56:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:56:17.531001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa73ce-bc42-4a9b-b7ad-8885a1863e81 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:17.628191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa73ce-bc42-4a9b-b7ad-8885a1863e81 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:17.662587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56e33-4965-4a7f-bcb4-f190d2eb1dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:17.663468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56e33-4965-4a7f-bcb4-f190d2eb1dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:17.663748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56e33-4965-4a7f-bcb4-f190d2eb1dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:17.664025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56e33-4965-4a7f-bcb4-f190d2eb1dc7 None admin] PATH_INFO: `/v3/projects/0ec881efe04d40b0b985ad1484cb2bce` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:17.665180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56e33-4965-4a7f-bcb4-f190d2eb1dc7 None admin] RBAC: Authorizing `identity:get_project(project_id=0ec881efe04d40b0b985ad1484cb2bce)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:17.666595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56e33-4965-4a7f-bcb4-f190d2eb1dc7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:17.668288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 587/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:56:17 2022] GET /identity/v3/projects/0ec881efe04d40b0b985ad1484cb2bce => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:17.674309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071bd2c-6724-42b9-bfbe-e6d2c8d505b4 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:17.741246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:17.770012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071bd2c-6724-42b9-bfbe-e6d2c8d505b4 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:17.803124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c34728-0688-49bc-aac0-a3e8b0be1f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:17.803752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34728-0688-49bc-aac0-a3e8b0be1f63 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:17.804034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34728-0688-49bc-aac0-a3e8b0be1f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:17.804309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34728-0688-49bc-aac0-a3e8b0be1f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:17.805124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c34728-0688-49bc-aac0-a3e8b0be1f63 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=0ec881efe04d40b0b985ad1484cb2bce, user.id=13fba1a9cd50487cab697722d39eeaae) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:56:17.805435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c34728-0688-49bc-aac0-a3e8b0be1f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:17.806870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c34728-0688-49bc-aac0-a3e8b0be1f63 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:17.812137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 598/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:56:17 2022] GET /identity/v3/role_assignments?user.id=13fba1a9cd50487cab697722d39eeaae&scope.project.id=0ec881efe04d40b0b985ad1484cb2bce&role.id=af8084c48e3c40298e26d44d6d14595a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:19.966775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70d9f4-1145-4e59-9f4d-ec894a65b044 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:19.967290 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70d9f4-1145-4e59-9f4d-ec894a65b044 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:19.967405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70d9f4-1145-4e59-9f4d-ec894a65b044 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:19.968687 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 588/1186] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:56:19.974799 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6c60-4918-4ebc-8275-7b83165e7acd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:19.975187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6c60-4918-4ebc-8275-7b83165e7acd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:19.975354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6c60-4918-4ebc-8275-7b83165e7acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:19.992258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-800d6c60-4918-4ebc-8275-7b83165e7acd None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:56:19.993427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-800d6c60-4918-4ebc-8275-7b83165e7acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:56:20.067779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 599/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:56:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:56:20.097828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70d9f4-1145-4e59-9f4d-ec894a65b044 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:20.134820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:20.199107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70d9f4-1145-4e59-9f4d-ec894a65b044 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:20.236154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4024bc-98b5-4157-9fdd-1439f075ecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:20.236867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4024bc-98b5-4157-9fdd-1439f075ecf3 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:20.237146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4024bc-98b5-4157-9fdd-1439f075ecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:20.237420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4024bc-98b5-4157-9fdd-1439f075ecf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:20.247620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4024bc-98b5-4157-9fdd-1439f075ecf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ed4024bc-98b5-4157-9fdd-1439f075ecf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:56:20.256151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:56:20.257551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:56:20.258601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:56:20.259417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 589/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:56:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:56:20.265575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d6c60-4918-4ebc-8275-7b83165e7acd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:20.328335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:20.362163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d6c60-4918-4ebc-8275-7b83165e7acd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:20.398171 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9352-a8a3-41cc-86c0-d3f6401b063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:20.398860 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9352-a8a3-41cc-86c0-d3f6401b063c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:20.399146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9352-a8a3-41cc-86c0-d3f6401b063c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:20.399424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9352-a8a3-41cc-86c0-d3f6401b063c None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:20.400170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9352-a8a3-41cc-86c0-d3f6401b063c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:56:20.400476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9352-a8a3-41cc-86c0-d3f6401b063c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:20.401851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9352-a8a3-41cc-86c0-d3f6401b063c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:20.409964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 600/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:56:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:20.416216 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4024bc-98b5-4157-9fdd-1439f075ecf3 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:20.511454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:20.517650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4024bc-98b5-4157-9fdd-1439f075ecf3 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:20.549946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53eff75-9cb9-45f6-87cd-493c36993091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:20.550849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eff75-9cb9-45f6-87cd-493c36993091 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:20.551655 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eff75-9cb9-45f6-87cd-493c36993091 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:20.552001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eff75-9cb9-45f6-87cd-493c36993091 None admin] PATH_INFO: `/v3/users/13fba1a9cd50487cab697722d39eeaae` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:20.553177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eff75-9cb9-45f6-87cd-493c36993091 None admin] RBAC: Authorizing `identity:get_user(user_id=13fba1a9cd50487cab697722d39eeaae)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:20.554615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eff75-9cb9-45f6-87cd-493c36993091 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:20.556263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 590/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:56:20 2022] GET /identity/v3/users/13fba1a9cd50487cab697722d39eeaae => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:20.561925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9352-a8a3-41cc-86c0-d3f6401b063c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:20.673534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9352-a8a3-41cc-86c0-d3f6401b063c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:20.700072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:20.708784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756726a-976b-46ac-81e9-f48ccf6f0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:20.709633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756726a-976b-46ac-81e9-f48ccf6f0443 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:20.709914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756726a-976b-46ac-81e9-f48ccf6f0443 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:20.710188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756726a-976b-46ac-81e9-f48ccf6f0443 None admin] PATH_INFO: `/v3/projects/0ec881efe04d40b0b985ad1484cb2bce` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:20.711336 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756726a-976b-46ac-81e9-f48ccf6f0443 None admin] RBAC: Authorizing `identity:get_project(project_id=0ec881efe04d40b0b985ad1484cb2bce)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:20.712765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756726a-976b-46ac-81e9-f48ccf6f0443 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:20.714454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 601/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:56:20 2022] GET /identity/v3/projects/0ec881efe04d40b0b985ad1484cb2bce => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:20.720519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53eff75-9cb9-45f6-87cd-493c36993091 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:20.817689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53eff75-9cb9-45f6-87cd-493c36993091 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:20.850752 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86732-36f5-4446-b267-802e0216d2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:20.851634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86732-36f5-4446-b267-802e0216d2ec None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:20.851917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86732-36f5-4446-b267-802e0216d2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:20.852194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86732-36f5-4446-b267-802e0216d2ec None admin] PATH_INFO: `/v3/projects/0ec881efe04d40b0b985ad1484cb2bce/users/13fba1a9cd50487cab697722d39eeaae/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:20.854124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86732-36f5-4446-b267-802e0216d2ec None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec881efe04d40b0b985ad1484cb2bce, user_id=13fba1a9cd50487cab697722d39eeaae, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:20.855575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86732-36f5-4446-b267-802e0216d2ec None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:20.867633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 591/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:56:20 2022] PUT /identity/v3/projects/0ec881efe04d40b0b985ad1484cb2bce/users/13fba1a9cd50487cab697722d39eeaae/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:56:23.043924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0099-eac8-4a4c-aa38-7c4bb8d67d2f None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:23.044455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0099-eac8-4a4c-aa38-7c4bb8d67d2f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:23.044455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0099-eac8-4a4c-aa38-7c4bb8d67d2f None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:23.045835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 602/1193] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:56:23.051549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdff676-2887-4ec7-b591-e2b20b923b33 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:23.052114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdff676-2887-4ec7-b591-e2b20b923b33 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:23.052271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdff676-2887-4ec7-b591-e2b20b923b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:23.069642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0cdff676-2887-4ec7-b591-e2b20b923b33 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:56:23.071618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0cdff676-2887-4ec7-b591-e2b20b923b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:56:23.091130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:23.141449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 592/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:56:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:56:23.165417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0099-eac8-4a4c-aa38-7c4bb8d67d2f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:23.264530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0099-eac8-4a4c-aa38-7c4bb8d67d2f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:23.297656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4689c-56e4-4d7f-a01c-0d73c3276c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:23.298372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4689c-56e4-4d7f-a01c-0d73c3276c59 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:23.298654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4689c-56e4-4d7f-a01c-0d73c3276c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:23.298963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4689c-56e4-4d7f-a01c-0d73c3276c59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:23.310214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4689c-56e4-4d7f-a01c-0d73c3276c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-aab4689c-56e4-4d7f-a01c-0d73c3276c59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:56:23.317991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:56:23.319126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:56:23.320342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 603/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:56:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:56:23.325182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdff676-2887-4ec7-b591-e2b20b923b33 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:23.431543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdff676-2887-4ec7-b591-e2b20b923b33 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:23.464828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce07cda-9c45-461f-8e08-f26a6f964a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:23.465490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce07cda-9c45-461f-8e08-f26a6f964a4d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:23.465775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce07cda-9c45-461f-8e08-f26a6f964a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:23.466052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce07cda-9c45-461f-8e08-f26a6f964a4d None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:23.466821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce07cda-9c45-461f-8e08-f26a6f964a4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:56:23.467130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce07cda-9c45-461f-8e08-f26a6f964a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:23.468499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce07cda-9c45-461f-8e08-f26a6f964a4d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:23.477088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 593/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:56:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:23.482822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4689c-56e4-4d7f-a01c-0d73c3276c59 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:23.538288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:23.579776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4689c-56e4-4d7f-a01c-0d73c3276c59 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:23.612482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141593bc-0f6f-4d6d-afac-8d71804508ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:23.613332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141593bc-0f6f-4d6d-afac-8d71804508ef None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:23.613641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141593bc-0f6f-4d6d-afac-8d71804508ef None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:23.613909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141593bc-0f6f-4d6d-afac-8d71804508ef None admin] PATH_INFO: `/v3/users/13fba1a9cd50487cab697722d39eeaae` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:23.615090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141593bc-0f6f-4d6d-afac-8d71804508ef None admin] RBAC: Authorizing `identity:get_user(user_id=13fba1a9cd50487cab697722d39eeaae)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:23.616496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141593bc-0f6f-4d6d-afac-8d71804508ef None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:23.618094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 604/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Mon May 23 17:56:23 2022] GET /identity/v3/users/13fba1a9cd50487cab697722d39eeaae => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:23.623756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce07cda-9c45-461f-8e08-f26a6f964a4d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:23.642096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:23.724222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce07cda-9c45-461f-8e08-f26a6f964a4d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:23.756468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2663eea-ab14-43bd-af47-b8ae9c4de81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:23.757390 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2663eea-ab14-43bd-af47-b8ae9c4de81a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:23.757700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2663eea-ab14-43bd-af47-b8ae9c4de81a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:23.757996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2663eea-ab14-43bd-af47-b8ae9c4de81a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:23.823545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2663eea-ab14-43bd-af47-b8ae9c4de81a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:23.824984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2663eea-ab14-43bd-af47-b8ae9c4de81a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:23.841975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:23.923113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 594/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:56:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 17:56:23.928933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141593bc-0f6f-4d6d-afac-8d71804508ef None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:24.024361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141593bc-0f6f-4d6d-afac-8d71804508ef None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:24.047129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:24.057484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692135e7-3fd7-4175-aa3a-d884b0785dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:24.058313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692135e7-3fd7-4175-aa3a-d884b0785dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:24.058591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692135e7-3fd7-4175-aa3a-d884b0785dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:24.058893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692135e7-3fd7-4175-aa3a-d884b0785dc1 None admin] PATH_INFO: `/v3/projects/0ec881efe04d40b0b985ad1484cb2bce` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:24.060027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692135e7-3fd7-4175-aa3a-d884b0785dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=0ec881efe04d40b0b985ad1484cb2bce)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:24.061433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692135e7-3fd7-4175-aa3a-d884b0785dc1 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:24.063104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 605/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Mon May 23 17:56:23 2022] GET /identity/v3/projects/0ec881efe04d40b0b985ad1484cb2bce => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:24.069490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2663eea-ab14-43bd-af47-b8ae9c4de81a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:56:24.164907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2663eea-ab14-43bd-af47-b8ae9c4de81a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:56:24.180483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:24.198394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed93ff-0676-493e-9e23-8bffb1333066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:56:24.199063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed93ff-0676-493e-9e23-8bffb1333066 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:56:24.199348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed93ff-0676-493e-9e23-8bffb1333066 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:56:24.199622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed93ff-0676-493e-9e23-8bffb1333066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:56:24.200440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed93ff-0676-493e-9e23-8bffb1333066 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=0ec881efe04d40b0b985ad1484cb2bce, user.id=13fba1a9cd50487cab697722d39eeaae) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:56:24.200754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed93ff-0676-493e-9e23-8bffb1333066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:56:24.202170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed93ff-0676-493e-9e23-8bffb1333066 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:56:24.208698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 595/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:56:24 2022] GET /identity/v3/role_assignments?user.id=13fba1a9cd50487cab697722d39eeaae&scope.project.id=0ec881efe04d40b0b985ad1484cb2bce&role.id=af8084c48e3c40298e26d44d6d14595a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:56:34.053540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:56:34.205303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=10 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:24.641529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a0656-4c3a-4e71-86d9-1451fd8fc479 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:24.642265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a0656-4c3a-4e71-86d9-1451fd8fc479 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:24.642483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a0656-4c3a-4e71-86d9-1451fd8fc479 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:24.644046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 606/1201] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:57:24.649721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b5b5-6dcd-48ea-9616-5e11e71368b0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:24.650194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b5b5-6dcd-48ea-9616-5e11e71368b0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:24.650274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b5b5-6dcd-48ea-9616-5e11e71368b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:24.673648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4825b5b5-6dcd-48ea-9616-5e11e71368b0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:57:24.674972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4825b5b5-6dcd-48ea-9616-5e11e71368b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:57:24.770794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 596/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:57:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:57:24.793918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a0656-4c3a-4e71-86d9-1451fd8fc479 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:24.942032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a0656-4c3a-4e71-86d9-1451fd8fc479 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:24.992191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ca1c8-dbfd-420b-b2e8-ddaa41dce733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:24.992780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca1c8-dbfd-420b-b2e8-ddaa41dce733 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:24.993078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca1c8-dbfd-420b-b2e8-ddaa41dce733 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:24.993338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca1c8-dbfd-420b-b2e8-ddaa41dce733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:25.006674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ca1c8-dbfd-420b-b2e8-ddaa41dce733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:25.008305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ca1c8-dbfd-420b-b2e8-ddaa41dce733 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-b53ca1c8-dbfd-420b-b2e8-ddaa41dce733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:25.028080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:25.030027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:25.033932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:25.033932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:25.033932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:25.033932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:25.033932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 607/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:25.036405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b5b5-6dcd-48ea-9616-5e11e71368b0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:25.182880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b5b5-6dcd-48ea-9616-5e11e71368b0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:25.221060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:25.227669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372c18-6643-4c1f-b8b0-924f9596e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:25.228413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372c18-6643-4c1f-b8b0-924f9596e99b None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:25.228701 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372c18-6643-4c1f-b8b0-924f9596e99b None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:25.229025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372c18-6643-4c1f-b8b0-924f9596e99b None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:25.229697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372c18-6643-4c1f-b8b0-924f9596e99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:25.230002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372c18-6643-4c1f-b8b0-924f9596e99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:25.231389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372c18-6643-4c1f-b8b0-924f9596e99b None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:25.244356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 597/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:25.251859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ca1c8-dbfd-420b-b2e8-ddaa41dce733 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:25.326517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:25.401602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ca1c8-dbfd-420b-b2e8-ddaa41dce733 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:25.444203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed6edd-7195-4a31-9fc0-8dd7891b2614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:25.444816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6edd-7195-4a31-9fc0-8dd7891b2614 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:25.445103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6edd-7195-4a31-9fc0-8dd7891b2614 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:25.445444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed6edd-7195-4a31-9fc0-8dd7891b2614 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:25.446159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed6edd-7195-4a31-9fc0-8dd7891b2614 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:25.447575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed6edd-7195-4a31-9fc0-8dd7891b2614 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:25.474843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 608/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Mon May 23 17:57:25 2022] POST /identity/v3/users => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:57:28.186076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26387a-9f03-47c9-b347-b84159e2d2f0 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:28.186670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26387a-9f03-47c9-b347-b84159e2d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:28.186670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26387a-9f03-47c9-b347-b84159e2d2f0 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:28.189492 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 598/1206] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:57:28.193714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2b20-c1e2-4ab1-868c-5121d893756c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:28.194165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2b20-c1e2-4ab1-868c-5121d893756c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:28.194343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2b20-c1e2-4ab1-868c-5121d893756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:28.214040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fd6c2b20-c1e2-4ab1-868c-5121d893756c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:57:28.215374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fd6c2b20-c1e2-4ab1-868c-5121d893756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:57:28.287540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 609/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:57:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:57:28.314484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26387a-9f03-47c9-b347-b84159e2d2f0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:28.446264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26387a-9f03-47c9-b347-b84159e2d2f0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:28.491497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916374c-407b-4e0c-bd67-919ecb42bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:28.492559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916374c-407b-4e0c-bd67-919ecb42bd44 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:28.492854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916374c-407b-4e0c-bd67-919ecb42bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:28.493138 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916374c-407b-4e0c-bd67-919ecb42bd44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:28.505417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916374c-407b-4e0c-bd67-919ecb42bd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-4916374c-407b-4e0c-bd67-919ecb42bd44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:57:28.514312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:28.515451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:28.516388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 599/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:57:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:28.522309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c2b20-c1e2-4ab1-868c-5121d893756c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:28.568122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:28.644090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c2b20-c1e2-4ab1-868c-5121d893756c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:28.681679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebb141-c824-4191-b18e-34df4f04f811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:28.682420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebb141-c824-4191-b18e-34df4f04f811 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:28.682728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebb141-c824-4191-b18e-34df4f04f811 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:28.683066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebb141-c824-4191-b18e-34df4f04f811 None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:28.683845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebb141-c824-4191-b18e-34df4f04f811 None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:28.684217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebb141-c824-4191-b18e-34df4f04f811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:28.685705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebb141-c824-4191-b18e-34df4f04f811 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:28.695454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 610/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:57:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:28.705493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916374c-407b-4e0c-bd67-919ecb42bd44 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:28.764352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:28.832244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916374c-407b-4e0c-bd67-919ecb42bd44 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:28.877976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd18d07-b164-462e-8550-aef7b4df7209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:28.878841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd18d07-b164-462e-8550-aef7b4df7209 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:28.879186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd18d07-b164-462e-8550-aef7b4df7209 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:28.879532 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd18d07-b164-462e-8550-aef7b4df7209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:28.892081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd18d07-b164-462e-8550-aef7b4df7209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:28.893709 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd18d07-b164-462e-8550-aef7b4df7209 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-0cd18d07-b164-462e-8550-aef7b4df7209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:28.917211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:28.918271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:28.919810 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:28.919810 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:28.919810 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:28.919810 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:28.919810 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 600/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:57:28.925891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebb141-c824-4191-b18e-34df4f04f811 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:29.033044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:29.036147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebb141-c824-4191-b18e-34df4f04f811 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:29.079751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d153a8-16b3-4efd-a542-3fcaedb7f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:29.080394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d153a8-16b3-4efd-a542-3fcaedb7f928 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:29.080680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d153a8-16b3-4efd-a542-3fcaedb7f928 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:29.080976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d153a8-16b3-4efd-a542-3fcaedb7f928 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:29.081677 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d153a8-16b3-4efd-a542-3fcaedb7f928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:29.081990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d153a8-16b3-4efd-a542-3fcaedb7f928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:29.083387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d153a8-16b3-4efd-a542-3fcaedb7f928 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:29.101470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 611/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:29.102511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd18d07-b164-462e-8550-aef7b4df7209 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:29.222079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd18d07-b164-462e-8550-aef7b4df7209 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:29.223956 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:29.265293 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00c0da-2108-40b5-a3b6-33d703fcddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:29.266262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00c0da-2108-40b5-a3b6-33d703fcddd8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:29.266586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00c0da-2108-40b5-a3b6-33d703fcddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:29.267089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00c0da-2108-40b5-a3b6-33d703fcddd8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:29.275088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00c0da-2108-40b5-a3b6-33d703fcddd8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:29.276582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00c0da-2108-40b5-a3b6-33d703fcddd8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-4f00c0da-2108-40b5-a3b6-33d703fcddd8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:57:29.293389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:29.294453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:29.300866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 601/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:57:29.303108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d153a8-16b3-4efd-a542-3fcaedb7f928 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:29.425856 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d153a8-16b3-4efd-a542-3fcaedb7f928 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:29.466085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88fce5-751b-45cc-ba40-de2456412301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:29.466861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88fce5-751b-45cc-ba40-de2456412301 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:29.467184 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88fce5-751b-45cc-ba40-de2456412301 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:29.467489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88fce5-751b-45cc-ba40-de2456412301 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:29.468451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88fce5-751b-45cc-ba40-de2456412301 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:29.468761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88fce5-751b-45cc-ba40-de2456412301 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:29.471031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88fce5-751b-45cc-ba40-de2456412301 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:29.495183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 612/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Mon May 23 17:57:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:29.499825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00c0da-2108-40b5-a3b6-33d703fcddd8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:29.628208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00c0da-2108-40b5-a3b6-33d703fcddd8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:29.674420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85910cb-90eb-4dd5-b97d-03e66247100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:29.675206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85910cb-90eb-4dd5-b97d-03e66247100d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:29.675530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85910cb-90eb-4dd5-b97d-03e66247100d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:29.675812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85910cb-90eb-4dd5-b97d-03e66247100d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:29.719223 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:29.774518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85910cb-90eb-4dd5-b97d-03e66247100d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:29.776327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85910cb-90eb-4dd5-b97d-03e66247100d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:29.892885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 602/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:57:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:57:29.894112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88fce5-751b-45cc-ba40-de2456412301 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:29.915226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:30.010313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88fce5-751b-45cc-ba40-de2456412301 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:30.053939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95ae18-fdb8-4ca1-b044-9c65d380437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:30.054884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95ae18-fdb8-4ca1-b044-9c65d380437b None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:30.055238 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95ae18-fdb8-4ca1-b044-9c65d380437b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:30.055510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95ae18-fdb8-4ca1-b044-9c65d380437b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:30.068379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95ae18-fdb8-4ca1-b044-9c65d380437b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:30.070580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95ae18-fdb8-4ca1-b044-9c65d380437b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1e95ae18-fdb8-4ca1-b044-9c65d380437b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:30.092599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:30.093813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:30.095755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:30.095755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:30.095755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:30.095755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:30.095755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 613/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:30.101824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85910cb-90eb-4dd5-b97d-03e66247100d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:30.185874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:30.230007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85910cb-90eb-4dd5-b97d-03e66247100d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:30.266888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f92c6-4b7f-497e-8c0c-bb3aee727832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:30.267682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f92c6-4b7f-497e-8c0c-bb3aee727832 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:30.268087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f92c6-4b7f-497e-8c0c-bb3aee727832 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:30.268337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f92c6-4b7f-497e-8c0c-bb3aee727832 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:30.269123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f92c6-4b7f-497e-8c0c-bb3aee727832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:30.269496 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f92c6-4b7f-497e-8c0c-bb3aee727832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:30.271001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f92c6-4b7f-497e-8c0c-bb3aee727832 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:30.283947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 603/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:30.289626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95ae18-fdb8-4ca1-b044-9c65d380437b None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:30.377271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:30.415340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95ae18-fdb8-4ca1-b044-9c65d380437b None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:30.456390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80370e7a-bee1-4910-b6b8-f4fc1329e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:30.457201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80370e7a-bee1-4910-b6b8-f4fc1329e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:30.457483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80370e7a-bee1-4910-b6b8-f4fc1329e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:30.457752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80370e7a-bee1-4910-b6b8-f4fc1329e6d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:30.464902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80370e7a-bee1-4910-b6b8-f4fc1329e6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:30.466329 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80370e7a-bee1-4910-b6b8-f4fc1329e6d2 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-80370e7a-bee1-4910-b6b8-f4fc1329e6d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:57:30.481752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:30.483074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:30.484005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:57:30.484005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:57:30.484005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:57:30.484005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:57:30.484005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:57:30.484005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:57:30.484005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:30.484005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:30.484005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 614/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:57:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:30.490424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f92c6-4b7f-497e-8c0c-bb3aee727832 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:30.613599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f92c6-4b7f-497e-8c0c-bb3aee727832 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:30.642192 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:30.656191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9af899-3234-4fc3-a720-79b9f81d25c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:30.657534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9af899-3234-4fc3-a720-79b9f81d25c7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:30.657802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9af899-3234-4fc3-a720-79b9f81d25c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:30.658090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9af899-3234-4fc3-a720-79b9f81d25c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:30.659131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9af899-3234-4fc3-a720-79b9f81d25c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:30.659493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9af899-3234-4fc3-a720-79b9f81d25c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:30.661064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9af899-3234-4fc3-a720-79b9f81d25c7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:30.679537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 604/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:57:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:30.681046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80370e7a-bee1-4910-b6b8-f4fc1329e6d2 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:30.797913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80370e7a-bee1-4910-b6b8-f4fc1329e6d2 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:30.830493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:30.839326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274ebed-d61a-458f-aa74-6c735f9b6b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:30.840201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274ebed-d61a-458f-aa74-6c735f9b6b30 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:30.840539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274ebed-d61a-458f-aa74-6c735f9b6b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:30.840803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274ebed-d61a-458f-aa74-6c735f9b6b30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:30.841749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274ebed-d61a-458f-aa74-6c735f9b6b30 None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=77e042a473204d358e3b0682bf1338d7) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:30.842067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274ebed-d61a-458f-aa74-6c735f9b6b30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:30.843679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274ebed-d61a-458f-aa74-6c735f9b6b30 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:30.851608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 615/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:57:30 2022] GET /identity/v3/role_assignments?user.id=77e042a473204d358e3b0682bf1338d7&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:57:33.277808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195e9e7-96b5-4914-ad8b-c77050b91a49 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:33.278380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195e9e7-96b5-4914-ad8b-c77050b91a49 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:33.278380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195e9e7-96b5-4914-ad8b-c77050b91a49 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:33.279758 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 605/1220] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:57:33.286169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a07a22-8528-43e1-9f54-9898faccc7ad None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:33.286605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a07a22-8528-43e1-9f54-9898faccc7ad None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:33.286761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a07a22-8528-43e1-9f54-9898faccc7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:33.307783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-99a07a22-8528-43e1-9f54-9898faccc7ad None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:57:33.309191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-99a07a22-8528-43e1-9f54-9898faccc7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:57:33.386646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 616/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:57:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:57:33.411528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195e9e7-96b5-4914-ad8b-c77050b91a49 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:33.522211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195e9e7-96b5-4914-ad8b-c77050b91a49 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:33.560097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c406ef-5db1-477b-bcec-0019afe11f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:33.560831 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c406ef-5db1-477b-bcec-0019afe11f3d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:33.561136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c406ef-5db1-477b-bcec-0019afe11f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:33.561417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c406ef-5db1-477b-bcec-0019afe11f3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:33.572448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c406ef-5db1-477b-bcec-0019afe11f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-e1c406ef-5db1-477b-bcec-0019afe11f3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:57:33.580210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:33.581233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:33.582780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 606/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:57:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:33.588004 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a07a22-8528-43e1-9f54-9898faccc7ad None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:33.693399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a07a22-8528-43e1-9f54-9898faccc7ad None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:33.717455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:33.728887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb9931-4af2-443c-90f4-2e868f202d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:33.729607 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb9931-4af2-443c-90f4-2e868f202d3a None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:33.729917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb9931-4af2-443c-90f4-2e868f202d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:33.730228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb9931-4af2-443c-90f4-2e868f202d3a None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:33.731039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb9931-4af2-443c-90f4-2e868f202d3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:33.731345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb9931-4af2-443c-90f4-2e868f202d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:33.732797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb9931-4af2-443c-90f4-2e868f202d3a None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:33.742016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 617/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:57:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:33.748221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c406ef-5db1-477b-bcec-0019afe11f3d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:33.807825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:33.874928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c406ef-5db1-477b-bcec-0019afe11f3d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:33.917630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d855-794a-4ab0-883b-82ec504c3318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:33.918593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d855-794a-4ab0-883b-82ec504c3318 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:33.918899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d855-794a-4ab0-883b-82ec504c3318 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:33.919173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d855-794a-4ab0-883b-82ec504c3318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:33.934063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0d855-794a-4ab0-883b-82ec504c3318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:33.935938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0d855-794a-4ab0-883b-82ec504c3318 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-23e0d855-794a-4ab0-883b-82ec504c3318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:33.956132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:33.957155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:33.958177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:33.958177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:33.958177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:33.958177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:33.958177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 607/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:33.963129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb9931-4af2-443c-90f4-2e868f202d3a None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:34.083212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb9931-4af2-443c-90f4-2e868f202d3a None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:34.122136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3178910-dc96-41cc-9a14-947b4c876d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:34.123021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3178910-dc96-41cc-9a14-947b4c876d9f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:34.123315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3178910-dc96-41cc-9a14-947b4c876d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:34.123623 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3178910-dc96-41cc-9a14-947b4c876d9f None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:34.124558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3178910-dc96-41cc-9a14-947b4c876d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:34.124997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3178910-dc96-41cc-9a14-947b4c876d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:34.126810 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3178910-dc96-41cc-9a14-947b4c876d9f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:34.140491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 618/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:34.147170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d855-794a-4ab0-883b-82ec504c3318 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:34.256189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:34.263654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d855-794a-4ab0-883b-82ec504c3318 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:34.300616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d2c3a-41a0-4eb9-b2d3-ecbb30756b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:34.301491 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d2c3a-41a0-4eb9-b2d3-ecbb30756b1f None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:34.301777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d2c3a-41a0-4eb9-b2d3-ecbb30756b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:34.302086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d2c3a-41a0-4eb9-b2d3-ecbb30756b1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:34.311271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d2c3a-41a0-4eb9-b2d3-ecbb30756b1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:34.313452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d2c3a-41a0-4eb9-b2d3-ecbb30756b1f None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-011d2c3a-41a0-4eb9-b2d3-ecbb30756b1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:57:34.331168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:34.332364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:34.333566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 608/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:57:34.339304 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3178910-dc96-41cc-9a14-947b4c876d9f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:34.396596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:34.460088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3178910-dc96-41cc-9a14-947b4c876d9f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:34.497555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a46e97-4958-4e04-9f83-c01248184920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:34.498218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a46e97-4958-4e04-9f83-c01248184920 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:34.498497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a46e97-4958-4e04-9f83-c01248184920 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:34.498800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a46e97-4958-4e04-9f83-c01248184920 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:34.499844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a46e97-4958-4e04-9f83-c01248184920 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:34.500131 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a46e97-4958-4e04-9f83-c01248184920 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:34.502259 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a46e97-4958-4e04-9f83-c01248184920 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:34.525168 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 619/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Mon May 23 17:57:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:34.530866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d2c3a-41a0-4eb9-b2d3-ecbb30756b1f None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:34.637107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d2c3a-41a0-4eb9-b2d3-ecbb30756b1f None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:34.673637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01cd7-70a7-41b1-a328-600af0d5a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:34.674372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01cd7-70a7-41b1-a328-600af0d5a586 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:34.674653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01cd7-70a7-41b1-a328-600af0d5a586 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:34.675045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01cd7-70a7-41b1-a328-600af0d5a586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:34.686364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e01cd7-70a7-41b1-a328-600af0d5a586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:34.688642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e01cd7-70a7-41b1-a328-600af0d5a586 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-d9e01cd7-70a7-41b1-a328-600af0d5a586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:34.709360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:34.715251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:34.716379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:34.716379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:34.716379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:34.716379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:34.716379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 609/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:34.717204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a46e97-4958-4e04-9f83-c01248184920 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:34.827724 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a46e97-4958-4e04-9f83-c01248184920 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:34.831066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:34.874690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264660ef-0bf2-446f-ba72-2075b39f05af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:34.875642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264660ef-0bf2-446f-ba72-2075b39f05af None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:34.875937 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264660ef-0bf2-446f-ba72-2075b39f05af None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:34.876303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264660ef-0bf2-446f-ba72-2075b39f05af None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:34.877181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264660ef-0bf2-446f-ba72-2075b39f05af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:34.877566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264660ef-0bf2-446f-ba72-2075b39f05af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:34.879136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264660ef-0bf2-446f-ba72-2075b39f05af None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:34.892986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 620/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:34.899246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01cd7-70a7-41b1-a328-600af0d5a586 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:34.911327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:35.021954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01cd7-70a7-41b1-a328-600af0d5a586 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:35.062613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558de86-8367-47de-8a4a-cca23796405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:35.064105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558de86-8367-47de-8a4a-cca23796405a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:35.064480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558de86-8367-47de-8a4a-cca23796405a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:35.064835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558de86-8367-47de-8a4a-cca23796405a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:35.073323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558de86-8367-47de-8a4a-cca23796405a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:35.075120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558de86-8367-47de-8a4a-cca23796405a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-d558de86-8367-47de-8a4a-cca23796405a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:57:35.090266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:35.091374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:35.092429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:57:35.092429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:57:35.092429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:57:35.092429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:57:35.092429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:57:35.092429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:57:35.092429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:35.092429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:35.092429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 610/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:35.097492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264660ef-0bf2-446f-ba72-2075b39f05af None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:35.216154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264660ef-0bf2-446f-ba72-2075b39f05af None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:35.258770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914701e-e714-4315-ad70-6b6402690a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:35.259433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914701e-e714-4315-ad70-6b6402690a3d None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:35.259718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914701e-e714-4315-ad70-6b6402690a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:35.259994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914701e-e714-4315-ad70-6b6402690a3d None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:35.260776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914701e-e714-4315-ad70-6b6402690a3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:35.261086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914701e-e714-4315-ad70-6b6402690a3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:35.262590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914701e-e714-4315-ad70-6b6402690a3d None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:35.275430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 621/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:57:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:35.283383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558de86-8367-47de-8a4a-cca23796405a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:35.372622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:35.414485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558de86-8367-47de-8a4a-cca23796405a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:35.455826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc7bab-10e4-45f9-8d0c-c22190fcb66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:35.456723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7bab-10e4-45f9-8d0c-c22190fcb66e None admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:35.457009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7bab-10e4-45f9-8d0c-c22190fcb66e None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:35.457283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7bab-10e4-45f9-8d0c-c22190fcb66e None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/77e042a473204d358e3b0682bf1338d7/roles/ced991a120aa41709516ad31b1c57a89` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:35.475515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc7bab-10e4-45f9-8d0c-c22190fcb66e None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=77e042a473204d358e3b0682bf1338d7, role_id=ced991a120aa41709516ad31b1c57a89)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:35.477010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc7bab-10e4-45f9-8d0c-c22190fcb66e None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:35.489608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 611/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:57:35 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/77e042a473204d358e3b0682bf1338d7/roles/ced991a120aa41709516ad31b1c57a89 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:57:37.907351 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fce6bf-85b8-4a5d-bbef-56a114b5bf92 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:37.908571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fce6bf-85b8-4a5d-bbef-56a114b5bf92 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:37.908571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fce6bf-85b8-4a5d-bbef-56a114b5bf92 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:37.909721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 622/1233] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:57:37.914986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551f4cf-5362-40e5-98dc-54eb124fe4ef None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:37.915424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551f4cf-5362-40e5-98dc-54eb124fe4ef None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:37.915545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551f4cf-5362-40e5-98dc-54eb124fe4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:37.932416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a551f4cf-5362-40e5-98dc-54eb124fe4ef None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:57:37.933615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a551f4cf-5362-40e5-98dc-54eb124fe4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:57:38.007425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 612/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:57:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:57:38.031155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fce6bf-85b8-4a5d-bbef-56a114b5bf92 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:38.058907 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:38.142659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fce6bf-85b8-4a5d-bbef-56a114b5bf92 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:38.179809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894db6a-d0d9-473f-9bdd-297e48d8e5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:38.180519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894db6a-d0d9-473f-9bdd-297e48d8e5bb None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:38.180800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894db6a-d0d9-473f-9bdd-297e48d8e5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:38.181070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894db6a-d0d9-473f-9bdd-297e48d8e5bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:38.191816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894db6a-d0d9-473f-9bdd-297e48d8e5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5894db6a-d0d9-473f-9bdd-297e48d8e5bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:57:38.199493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:38.200644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:38.207340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 623/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Mon May 23 17:57:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:38.208420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551f4cf-5362-40e5-98dc-54eb124fe4ef None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:38.259135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:38.329239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551f4cf-5362-40e5-98dc-54eb124fe4ef None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:38.372074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df8dc1-667c-46ab-bf20-bd1f5cfa67dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:38.372751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8dc1-667c-46ab-bf20-bd1f5cfa67dc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:38.373131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8dc1-667c-46ab-bf20-bd1f5cfa67dc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:38.373411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8dc1-667c-46ab-bf20-bd1f5cfa67dc None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:38.374148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df8dc1-667c-46ab-bf20-bd1f5cfa67dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:38.374452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df8dc1-667c-46ab-bf20-bd1f5cfa67dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:38.376474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df8dc1-667c-46ab-bf20-bd1f5cfa67dc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:38.387136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 613/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Mon May 23 17:57:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 17:57:38.393447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894db6a-d0d9-473f-9bdd-297e48d8e5bb None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:38.491430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:38.510476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894db6a-d0d9-473f-9bdd-297e48d8e5bb None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:38.552894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8365f6-2ebc-4847-8365-dfed62e8b373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:38.553954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8365f6-2ebc-4847-8365-dfed62e8b373 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:38.554235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8365f6-2ebc-4847-8365-dfed62e8b373 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:38.554519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8365f6-2ebc-4847-8365-dfed62e8b373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:38.567852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8365f6-2ebc-4847-8365-dfed62e8b373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:38.569522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8365f6-2ebc-4847-8365-dfed62e8b373 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-af8365f6-2ebc-4847-8365-dfed62e8b373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:38.589159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:38.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:38.591208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:38.591208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:38.591208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:38.591208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:38.591208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 624/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:38.596828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df8dc1-667c-46ab-bf20-bd1f5cfa67dc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:38.706244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df8dc1-667c-46ab-bf20-bd1f5cfa67dc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:38.716146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:38.746865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe5eae-5e49-4b35-a7d4-995e21e819c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:38.747498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe5eae-5e49-4b35-a7d4-995e21e819c6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:38.747816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe5eae-5e49-4b35-a7d4-995e21e819c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:38.748068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe5eae-5e49-4b35-a7d4-995e21e819c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:38.748832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe5eae-5e49-4b35-a7d4-995e21e819c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:38.749139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe5eae-5e49-4b35-a7d4-995e21e819c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:38.751054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe5eae-5e49-4b35-a7d4-995e21e819c6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:38.763619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 614/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:38.769721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8365f6-2ebc-4847-8365-dfed62e8b373 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:38.900762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8365f6-2ebc-4847-8365-dfed62e8b373 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:38.941663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e1272-3995-4be5-8906-f7ca8ed14204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:38.942477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e1272-3995-4be5-8906-f7ca8ed14204 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:38.942787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e1272-3995-4be5-8906-f7ca8ed14204 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:38.943045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e1272-3995-4be5-8906-f7ca8ed14204 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:38.946626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:38.955191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e1272-3995-4be5-8906-f7ca8ed14204 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:38.957032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e1272-3995-4be5-8906-f7ca8ed14204 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-579e1272-3995-4be5-8906-f7ca8ed14204 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:57:38.974233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:38.975464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:38.976578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 625/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:38.982127 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe5eae-5e49-4b35-a7d4-995e21e819c6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:39.107734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe5eae-5e49-4b35-a7d4-995e21e819c6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:39.149840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff789-141b-4be8-9e33-72eccfc2182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:39.150652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff789-141b-4be8-9e33-72eccfc2182c None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:39.150990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff789-141b-4be8-9e33-72eccfc2182c None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:39.151282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff789-141b-4be8-9e33-72eccfc2182c None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:39.152373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dff789-141b-4be8-9e33-72eccfc2182c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:39.152795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dff789-141b-4be8-9e33-72eccfc2182c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:39.154381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dff789-141b-4be8-9e33-72eccfc2182c None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:39.173086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 615/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Mon May 23 17:57:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:39.178977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e1272-3995-4be5-8906-f7ca8ed14204 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:39.300544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e1272-3995-4be5-8906-f7ca8ed14204 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:39.353489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11190734-f17f-4703-aa79-165990cfec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:39.354160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11190734-f17f-4703-aa79-165990cfec57 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:39.354436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11190734-f17f-4703-aa79-165990cfec57 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:39.354763 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11190734-f17f-4703-aa79-165990cfec57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:39.418124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:39.426602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11190734-f17f-4703-aa79-165990cfec57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:39.428352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11190734-f17f-4703-aa79-165990cfec57 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:39.545124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 626/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:57:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:57:39.552239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff789-141b-4be8-9e33-72eccfc2182c None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:39.582627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:39.668944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff789-141b-4be8-9e33-72eccfc2182c None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:39.706954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ca3d7-673a-4056-8a2b-f09de5be342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:39.707861 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ca3d7-673a-4056-8a2b-f09de5be342d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:39.708202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ca3d7-673a-4056-8a2b-f09de5be342d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:39.708594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ca3d7-673a-4056-8a2b-f09de5be342d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:39.720843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ca3d7-673a-4056-8a2b-f09de5be342d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:39.722306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ca3d7-673a-4056-8a2b-f09de5be342d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-106ca3d7-673a-4056-8a2b-f09de5be342d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:39.742474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:39.743704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:39.744860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:39.744860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:39.744860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:39.744860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:39.744860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 616/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 17:57:39.749768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11190734-f17f-4703-aa79-165990cfec57 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:39.856483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:39.863233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11190734-f17f-4703-aa79-165990cfec57 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:39.902386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab91123-9e7d-45a6-9a84-a1ddf513c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:39.903077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab91123-9e7d-45a6-9a84-a1ddf513c99c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:39.903365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab91123-9e7d-45a6-9a84-a1ddf513c99c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:39.903637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab91123-9e7d-45a6-9a84-a1ddf513c99c None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:39.904354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab91123-9e7d-45a6-9a84-a1ddf513c99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:39.904661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab91123-9e7d-45a6-9a84-a1ddf513c99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:39.906742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab91123-9e7d-45a6-9a84-a1ddf513c99c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:39.928805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 627/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:39.934898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ca3d7-673a-4056-8a2b-f09de5be342d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:40.025719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:40.050960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ca3d7-673a-4056-8a2b-f09de5be342d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:40.089130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fdc3d-5a29-41e2-9f96-2522fad09dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:40.089917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fdc3d-5a29-41e2-9f96-2522fad09dbd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:40.090197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fdc3d-5a29-41e2-9f96-2522fad09dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:40.090468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fdc3d-5a29-41e2-9f96-2522fad09dbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:40.097946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fdc3d-5a29-41e2-9f96-2522fad09dbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:40.099406 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fdc3d-5a29-41e2-9f96-2522fad09dbd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-ba4fdc3d-5a29-41e2-9f96-2522fad09dbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:57:40.113199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:40.114295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:40.115493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:57:40.115493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:57:40.115493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:57:40.115493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:57:40.115493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:57:40.115493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:57:40.115493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:40.115493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:40.119582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 617/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:40.120685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab91123-9e7d-45a6-9a84-a1ddf513c99c None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:40.229344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab91123-9e7d-45a6-9a84-a1ddf513c99c None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:40.269890 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d463a-af98-42dd-b708-e748acf36066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:40.271072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d463a-af98-42dd-b708-e748acf36066 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:40.271581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d463a-af98-42dd-b708-e748acf36066 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:40.271962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d463a-af98-42dd-b708-e748acf36066 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:40.272765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d463a-af98-42dd-b708-e748acf36066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:40.273081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d463a-af98-42dd-b708-e748acf36066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:40.274518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d463a-af98-42dd-b708-e748acf36066 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:40.297354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 628/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:40.299334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fdc3d-5a29-41e2-9f96-2522fad09dbd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:40.420120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fdc3d-5a29-41e2-9f96-2522fad09dbd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:40.457331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e7fc5-83c6-45a9-a3ff-5c3f7fd748b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:40.458229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e7fc5-83c6-45a9-a3ff-5c3f7fd748b7 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:40.458356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e7fc5-83c6-45a9-a3ff-5c3f7fd748b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:40.458571 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e7fc5-83c6-45a9-a3ff-5c3f7fd748b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:40.459410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e7fc5-83c6-45a9-a3ff-5c3f7fd748b7 None admin] RBAC: Adding query filter params (role.id=ced991a120aa41709516ad31b1c57a89, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=77e042a473204d358e3b0682bf1338d7) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:40.459725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e7fc5-83c6-45a9-a3ff-5c3f7fd748b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:40.461206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e7fc5-83c6-45a9-a3ff-5c3f7fd748b7 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:40.468429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 618/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:57:40 2022] GET /identity/v3/role_assignments?user.id=77e042a473204d358e3b0682bf1338d7&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=ced991a120aa41709516ad31b1c57a89 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:42.960617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b1ccf-af05-4fac-b8f1-d3f73d264040 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:42.961240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b1ccf-af05-4fac-b8f1-d3f73d264040 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:42.961440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b1ccf-af05-4fac-b8f1-d3f73d264040 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:42.963308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 629/1247] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:57:42.969086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0296-a224-4e8b-af4b-dc712c93efde None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:42.969761 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0296-a224-4e8b-af4b-dc712c93efde None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:42.969761 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0296-a224-4e8b-af4b-dc712c93efde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:42.975342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:42.989957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d41b0296-a224-4e8b-af4b-dc712c93efde None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:57:42.991260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d41b0296-a224-4e8b-af4b-dc712c93efde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:57:43.065376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 619/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:57:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:57:43.090005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b1ccf-af05-4fac-b8f1-d3f73d264040 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:43.110562 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:43.204807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b1ccf-af05-4fac-b8f1-d3f73d264040 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:43.244736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdcf88-e5bb-43b2-b1e1-486db52e2bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:43.245440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcf88-e5bb-43b2-b1e1-486db52e2bac None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:43.245730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcf88-e5bb-43b2-b1e1-486db52e2bac None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:43.246002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcf88-e5bb-43b2-b1e1-486db52e2bac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:43.258412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdcf88-e5bb-43b2-b1e1-486db52e2bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-48bdcf88-e5bb-43b2-b1e1-486db52e2bac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:57:43.266598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:43.267924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:43.268938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 630/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:43.273788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0296-a224-4e8b-af4b-dc712c93efde None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:43.396723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0296-a224-4e8b-af4b-dc712c93efde None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:43.432703 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:43.439276 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34c304-2570-472d-8d43-1a0308036f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:43.439990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34c304-2570-472d-8d43-1a0308036f34 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:43.440302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34c304-2570-472d-8d43-1a0308036f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:43.440594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34c304-2570-472d-8d43-1a0308036f34 None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:43.441336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34c304-2570-472d-8d43-1a0308036f34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:43.441641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34c304-2570-472d-8d43-1a0308036f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:43.443029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34c304-2570-472d-8d43-1a0308036f34 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:43.451451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 620/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:43.458187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdcf88-e5bb-43b2-b1e1-486db52e2bac None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:43.545829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:43.571326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdcf88-e5bb-43b2-b1e1-486db52e2bac None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:43.605169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c9124-b646-42dd-b441-69a803d4d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:43.605999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9124-b646-42dd-b441-69a803d4d757 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:43.606277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9124-b646-42dd-b441-69a803d4d757 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:43.606609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9124-b646-42dd-b441-69a803d4d757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:43.618447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c9124-b646-42dd-b441-69a803d4d757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:43.619972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c9124-b646-42dd-b441-69a803d4d757 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-cf5c9124-b646-42dd-b441-69a803d4d757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:43.638119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:43.639177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:43.640262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:43.640262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:43.640262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:43.640262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:43.640262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 631/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:43.645364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34c304-2570-472d-8d43-1a0308036f34 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:43.750567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34c304-2570-472d-8d43-1a0308036f34 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:43.784617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe001d-3bca-4e29-a1f8-e336f83984b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:43.785207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe001d-3bca-4e29-a1f8-e336f83984b1 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:43.785488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe001d-3bca-4e29-a1f8-e336f83984b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:43.785768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe001d-3bca-4e29-a1f8-e336f83984b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:43.786473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe001d-3bca-4e29-a1f8-e336f83984b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:43.786809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe001d-3bca-4e29-a1f8-e336f83984b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:43.788163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe001d-3bca-4e29-a1f8-e336f83984b1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:43.800516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 621/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:43.806205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c9124-b646-42dd-b441-69a803d4d757 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:43.914374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c9124-b646-42dd-b441-69a803d4d757 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:43.947916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:43.957571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad02c69-7cbd-48b4-a3e2-476016029613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:43.958411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad02c69-7cbd-48b4-a3e2-476016029613 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:43.958749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad02c69-7cbd-48b4-a3e2-476016029613 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:43.959005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad02c69-7cbd-48b4-a3e2-476016029613 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:43.966879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad02c69-7cbd-48b4-a3e2-476016029613 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:43.968326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad02c69-7cbd-48b4-a3e2-476016029613 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-0ad02c69-7cbd-48b4-a3e2-476016029613 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:57:43.982820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:43.984569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:43.985858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 632/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:43.990592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe001d-3bca-4e29-a1f8-e336f83984b1 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:44.054463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:44.107386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe001d-3bca-4e29-a1f8-e336f83984b1 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:44.153684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f6aa1-2767-4d40-9d33-e3ef1e00e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:44.155444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f6aa1-2767-4d40-9d33-e3ef1e00e19d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:44.155444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f6aa1-2767-4d40-9d33-e3ef1e00e19d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:44.155444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f6aa1-2767-4d40-9d33-e3ef1e00e19d None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:44.155791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f6aa1-2767-4d40-9d33-e3ef1e00e19d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:44.156105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f6aa1-2767-4d40-9d33-e3ef1e00e19d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:44.157706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f6aa1-2767-4d40-9d33-e3ef1e00e19d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:44.177779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 622/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Mon May 23 17:57:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:44.183720 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad02c69-7cbd-48b4-a3e2-476016029613 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:44.291082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad02c69-7cbd-48b4-a3e2-476016029613 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:44.349627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd35218-9c07-49ed-91bb-9125b7658328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:44.350188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd35218-9c07-49ed-91bb-9125b7658328 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:44.350459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd35218-9c07-49ed-91bb-9125b7658328 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:44.350788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd35218-9c07-49ed-91bb-9125b7658328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:44.409068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:44.423142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd35218-9c07-49ed-91bb-9125b7658328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:44.424619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd35218-9c07-49ed-91bb-9125b7658328 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:44.533214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 633/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:57:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:57:44.539073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f6aa1-2767-4d40-9d33-e3ef1e00e19d None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:44.645477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f6aa1-2767-4d40-9d33-e3ef1e00e19d None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:44.661424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:44.683736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf4781-aace-45de-b5e2-85e8f36bd9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:44.684523 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf4781-aace-45de-b5e2-85e8f36bd9bb None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:44.684808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf4781-aace-45de-b5e2-85e8f36bd9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:44.685087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf4781-aace-45de-b5e2-85e8f36bd9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:44.696478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf4781-aace-45de-b5e2-85e8f36bd9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:44.697943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf4781-aace-45de-b5e2-85e8f36bd9bb None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-2ddf4781-aace-45de-b5e2-85e8f36bd9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:44.716099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:44.717055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:44.717999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:44.717999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:44.717999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:44.717999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:44.717999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 623/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:44.723413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd35218-9c07-49ed-91bb-9125b7658328 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:44.813381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:44.825529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd35218-9c07-49ed-91bb-9125b7658328 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:44.859667 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1091b-6142-4f2c-adee-812d21dc1eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:44.860325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1091b-6142-4f2c-adee-812d21dc1eab None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:44.860605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1091b-6142-4f2c-adee-812d21dc1eab None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:44.860876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1091b-6142-4f2c-adee-812d21dc1eab None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:44.861587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1091b-6142-4f2c-adee-812d21dc1eab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:44.861915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1091b-6142-4f2c-adee-812d21dc1eab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:44.863312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1091b-6142-4f2c-adee-812d21dc1eab None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:44.874212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 634/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:44.880719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf4781-aace-45de-b5e2-85e8f36bd9bb None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:44.978517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf4781-aace-45de-b5e2-85e8f36bd9bb None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:45.011585 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d646c25-1f81-480a-8255-1cafb1bfb9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:45.012357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d646c25-1f81-480a-8255-1cafb1bfb9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:45.012638 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d646c25-1f81-480a-8255-1cafb1bfb9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:45.012912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d646c25-1f81-480a-8255-1cafb1bfb9f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:45.019517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d646c25-1f81-480a-8255-1cafb1bfb9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:45.020945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d646c25-1f81-480a-8255-1cafb1bfb9f9 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-2d646c25-1f81-480a-8255-1cafb1bfb9f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:57:45.035071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:45.036104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:45.037019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:57:45.037019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:57:45.037019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:57:45.037019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:57:45.037019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:57:45.037019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:57:45.037019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:45.037019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:45.037019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 624/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:45.041993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1091b-6142-4f2c-adee-812d21dc1eab None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:45.144876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1091b-6142-4f2c-adee-812d21dc1eab None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:45.177773 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba07cbb-66e8-4b40-9185-fd52d5d72ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:45.178409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba07cbb-66e8-4b40-9185-fd52d5d72ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:45.178689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba07cbb-66e8-4b40-9185-fd52d5d72ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:45.178990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba07cbb-66e8-4b40-9185-fd52d5d72ce5 None admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:45.179760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba07cbb-66e8-4b40-9185-fd52d5d72ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:45.180064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba07cbb-66e8-4b40-9185-fd52d5d72ce5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:45.181484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba07cbb-66e8-4b40-9185-fd52d5d72ce5 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:45.193066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 635/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:45.198958 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d646c25-1f81-480a-8255-1cafb1bfb9f9 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:45.224374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:45.297489 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d646c25-1f81-480a-8255-1cafb1bfb9f9 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:45.342149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca9894-84de-42bb-b3b3-c569dba98d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:45.342830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca9894-84de-42bb-b3b3-c569dba98d9a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:45.343116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca9894-84de-42bb-b3b3-c569dba98d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:45.344024 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca9894-84de-42bb-b3b3-c569dba98d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:45.344996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca9894-84de-42bb-b3b3-c569dba98d9a None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=77e042a473204d358e3b0682bf1338d7) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:45.345311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca9894-84de-42bb-b3b3-c569dba98d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:45.346767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca9894-84de-42bb-b3b3-c569dba98d9a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:45.352193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 625/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:57:45 2022] GET /identity/v3/role_assignments?user.id=77e042a473204d358e3b0682bf1338d7&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=af8084c48e3c40298e26d44d6d14595a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:47.491522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ef15c-ad7f-4659-8c90-a3a65ce96ba2 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:47.492048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ef15c-ad7f-4659-8c90-a3a65ce96ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:47.492141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ef15c-ad7f-4659-8c90-a3a65ce96ba2 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:47.493467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 636/1261] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:57:47.498841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735f99-76e8-4e08-88ac-8041481c5e5b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:47.499249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735f99-76e8-4e08-88ac-8041481c5e5b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:47.499396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735f99-76e8-4e08-88ac-8041481c5e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:47.516865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3c735f99-76e8-4e08-88ac-8041481c5e5b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:57:47.518074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3c735f99-76e8-4e08-88ac-8041481c5e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:57:47.583670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 626/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:57:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:57:47.606899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ef15c-ad7f-4659-8c90-a3a65ce96ba2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:47.617677 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:47.708666 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ef15c-ad7f-4659-8c90-a3a65ce96ba2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:47.741860 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77d35e-42b6-475b-938f-ea47fe55bbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:47.742649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77d35e-42b6-475b-938f-ea47fe55bbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:47.742960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77d35e-42b6-475b-938f-ea47fe55bbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:47.743233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77d35e-42b6-475b-938f-ea47fe55bbe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:47.752965 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77d35e-42b6-475b-938f-ea47fe55bbe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-9a77d35e-42b6-475b-938f-ea47fe55bbe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:57:47.760926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:47.762007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:47.763295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 637/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:57:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:47.768582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c735f99-76e8-4e08-88ac-8041481c5e5b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:47.786915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:47.865034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c735f99-76e8-4e08-88ac-8041481c5e5b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:47.899131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c29825-53a5-484b-950d-02b3774675cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:47.899780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c29825-53a5-484b-950d-02b3774675cc None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:47.900061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c29825-53a5-484b-950d-02b3774675cc None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:47.900336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c29825-53a5-484b-950d-02b3774675cc None admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:47.901073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c29825-53a5-484b-950d-02b3774675cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:47.901380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c29825-53a5-484b-950d-02b3774675cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:47.902767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c29825-53a5-484b-950d-02b3774675cc None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:47.910544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 627/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:57:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:47.916268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77d35e-42b6-475b-938f-ea47fe55bbe3 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:47.983299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:48.017373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77d35e-42b6-475b-938f-ea47fe55bbe3 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:48.049224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2cd99-9d01-4de0-9769-a7b63b89f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:48.049995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2cd99-9d01-4de0-9769-a7b63b89f865 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:48.050275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2cd99-9d01-4de0-9769-a7b63b89f865 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:48.050548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2cd99-9d01-4de0-9769-a7b63b89f865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:48.060643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2cd99-9d01-4de0-9769-a7b63b89f865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:48.062608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2cd99-9d01-4de0-9769-a7b63b89f865 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-10b2cd99-9d01-4de0-9769-a7b63b89f865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:48.079633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:48.080730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:48.081672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:48.081672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:48.081672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:48.081672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:48.081672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 638/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:48.086545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c29825-53a5-484b-950d-02b3774675cc None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:48.164090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:48.182689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c29825-53a5-484b-950d-02b3774675cc None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:48.215290 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b38893-73c2-470e-88b9-50ae890bc1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:48.215937 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38893-73c2-470e-88b9-50ae890bc1df None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:48.216214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38893-73c2-470e-88b9-50ae890bc1df None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:48.216483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b38893-73c2-470e-88b9-50ae890bc1df None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:48.217183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b38893-73c2-470e-88b9-50ae890bc1df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:48.217484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b38893-73c2-470e-88b9-50ae890bc1df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:48.218897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b38893-73c2-470e-88b9-50ae890bc1df None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:48.230140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 628/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:48.236422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2cd99-9d01-4de0-9769-a7b63b89f865 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:48.343172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2cd99-9d01-4de0-9769-a7b63b89f865 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:48.364351 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:48.382790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e27400-5b2c-4544-8ef6-62599252d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:48.383660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e27400-5b2c-4544-8ef6-62599252d538 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:48.383950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e27400-5b2c-4544-8ef6-62599252d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:48.384228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e27400-5b2c-4544-8ef6-62599252d538 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:48.391777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e27400-5b2c-4544-8ef6-62599252d538 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:48.393206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e27400-5b2c-4544-8ef6-62599252d538 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-73e27400-5b2c-4544-8ef6-62599252d538 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:57:48.407256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:48.408343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:48.409489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 639/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:48.414328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b38893-73c2-470e-88b9-50ae890bc1df None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:48.510034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b38893-73c2-470e-88b9-50ae890bc1df None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:48.542721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee2b3a-a620-440f-97f8-dca3ef5c49ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:48.543392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee2b3a-a620-440f-97f8-dca3ef5c49ca None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:48.543672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee2b3a-a620-440f-97f8-dca3ef5c49ca None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:48.543944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee2b3a-a620-440f-97f8-dca3ef5c49ca None admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:48.544763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee2b3a-a620-440f-97f8-dca3ef5c49ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:48.545066 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee2b3a-a620-440f-97f8-dca3ef5c49ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:48.547064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee2b3a-a620-440f-97f8-dca3ef5c49ca None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:48.555442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:48.565102 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 629/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Mon May 23 17:57:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:48.570605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e27400-5b2c-4544-8ef6-62599252d538 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:48.667838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e27400-5b2c-4544-8ef6-62599252d538 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:48.700771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bd640-ab7d-4ed0-b5b3-afdd1a2f7c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:48.701546 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd640-ab7d-4ed0-b5b3-afdd1a2f7c51 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:48.701825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd640-ab7d-4ed0-b5b3-afdd1a2f7c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:48.702095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd640-ab7d-4ed0-b5b3-afdd1a2f7c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:48.713378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bd640-ab7d-4ed0-b5b3-afdd1a2f7c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:48.714845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bd640-ab7d-4ed0-b5b3-afdd1a2f7c51 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-241bd640-ab7d-4ed0-b5b3-afdd1a2f7c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:48.732163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:48.733271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:48.734223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:48.734223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:48.734223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:48.734223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:48.734223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 640/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:48.739595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee2b3a-a620-440f-97f8-dca3ef5c49ca None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:48.834913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee2b3a-a620-440f-97f8-dca3ef5c49ca None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:48.867877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0375ed-2017-4bf5-a024-3ff60f605b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:48.868517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0375ed-2017-4bf5-a024-3ff60f605b03 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:48.868796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0375ed-2017-4bf5-a024-3ff60f605b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:48.869066 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0375ed-2017-4bf5-a024-3ff60f605b03 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:48.869767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0375ed-2017-4bf5-a024-3ff60f605b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:48.870067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0375ed-2017-4bf5-a024-3ff60f605b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:48.871437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0375ed-2017-4bf5-a024-3ff60f605b03 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:48.882497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 630/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:48.887960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bd640-ab7d-4ed0-b5b3-afdd1a2f7c51 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:48.918758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:48.985767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bd640-ab7d-4ed0-b5b3-afdd1a2f7c51 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:49.018386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ffe3-1846-4691-94f7-c41b2ef16482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:49.019185 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ffe3-1846-4691-94f7-c41b2ef16482 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:49.019468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ffe3-1846-4691-94f7-c41b2ef16482 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:49.019739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ffe3-1846-4691-94f7-c41b2ef16482 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:49.026139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3ffe3-1846-4691-94f7-c41b2ef16482 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:49.027591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3ffe3-1846-4691-94f7-c41b2ef16482 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-cef3ffe3-1846-4691-94f7-c41b2ef16482 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:57:49.041995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:49.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:49.044234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:57:49.044234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:57:49.044234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:57:49.044234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:57:49.044234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:57:49.044234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:57:49.044234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:49.044234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:49.044234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 641/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:49.048938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0375ed-2017-4bf5-a024-3ff60f605b03 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:49.107823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:49.149138 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0375ed-2017-4bf5-a024-3ff60f605b03 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:49.182125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f549-e58f-48f7-95dc-49c20a8e756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:49.182732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f549-e58f-48f7-95dc-49c20a8e756d None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:49.183022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f549-e58f-48f7-95dc-49c20a8e756d None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:49.183302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f549-e58f-48f7-95dc-49c20a8e756d None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:49.184077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f549-e58f-48f7-95dc-49c20a8e756d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:49.184388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f549-e58f-48f7-95dc-49c20a8e756d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:49.185803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f549-e58f-48f7-95dc-49c20a8e756d None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:49.197674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 631/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:49.204214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ffe3-1846-4691-94f7-c41b2ef16482 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:49.294887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:49.305489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ffe3-1846-4691-94f7-c41b2ef16482 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:49.343957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f16adf-b46d-49fb-a965-a6511ce7181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:49.344832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f16adf-b46d-49fb-a965-a6511ce7181b None admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:49.345112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f16adf-b46d-49fb-a965-a6511ce7181b None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:49.345384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f16adf-b46d-49fb-a965-a6511ce7181b None admin] PATH_INFO: `/v3/projects/6640de800f74494888cbb47aa590456c/users/77e042a473204d358e3b0682bf1338d7/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:49.347381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f16adf-b46d-49fb-a965-a6511ce7181b None admin] RBAC: Authorizing `identity:create_grant(project_id=6640de800f74494888cbb47aa590456c, user_id=77e042a473204d358e3b0682bf1338d7, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:49.348809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f16adf-b46d-49fb-a965-a6511ce7181b None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:49.360869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 642/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Mon May 23 17:57:49 2022] PUT /identity/v3/projects/6640de800f74494888cbb47aa590456c/users/77e042a473204d358e3b0682bf1338d7/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 17:57:51.525578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51fd9c-3aa7-49b9-bfd4-017638b6d853 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:51.525991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51fd9c-3aa7-49b9-bfd4-017638b6d853 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:51.526126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51fd9c-3aa7-49b9-bfd4-017638b6d853 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:51.527539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 632/1274] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:57:51.533218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8357a-1093-43e9-a4b1-71034c7bd731 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:51.533624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8357a-1093-43e9-a4b1-71034c7bd731 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:51.533810 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8357a-1093-43e9-a4b1-71034c7bd731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:51.550451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f1c8357a-1093-43e9-a4b1-71034c7bd731 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:57:51.551662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f1c8357a-1093-43e9-a4b1-71034c7bd731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:57:51.615500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 643/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:57:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:57:51.639136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51fd9c-3aa7-49b9-bfd4-017638b6d853 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:51.739773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51fd9c-3aa7-49b9-bfd4-017638b6d853 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:51.756959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:51.773495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9c185-90f9-4db9-977c-1b1dacfbf8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:51.774221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c185-90f9-4db9-977c-1b1dacfbf8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:51.774504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c185-90f9-4db9-977c-1b1dacfbf8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:51.774813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c185-90f9-4db9-977c-1b1dacfbf8e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:51.785261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9c185-90f9-4db9-977c-1b1dacfbf8e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-c7e9c185-90f9-4db9-977c-1b1dacfbf8e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 17:57:51.792778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:51.793882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:51.794950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 633/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Mon May 23 17:57:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:51.800733 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8357a-1093-43e9-a4b1-71034c7bd731 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:51.877887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:51.896632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8357a-1093-43e9-a4b1-71034c7bd731 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:51.930450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ced3a-7989-4111-9cae-8d498ba49d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:51.931126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ced3a-7989-4111-9cae-8d498ba49d1f None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:51.931406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ced3a-7989-4111-9cae-8d498ba49d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:51.931680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ced3a-7989-4111-9cae-8d498ba49d1f None admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:51.932412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ced3a-7989-4111-9cae-8d498ba49d1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:51.932714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ced3a-7989-4111-9cae-8d498ba49d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:51.934428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ced3a-7989-4111-9cae-8d498ba49d1f None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:51.943210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 644/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Mon May 23 17:57:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:51.949877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9c185-90f9-4db9-977c-1b1dacfbf8e2 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:52.060672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9c185-90f9-4db9-977c-1b1dacfbf8e2 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:52.092515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215cb33-749b-4e85-b3a2-4b09eac4ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:52.093867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215cb33-749b-4e85-b3a2-4b09eac4ecdd None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:52.094282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215cb33-749b-4e85-b3a2-4b09eac4ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:52.094556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215cb33-749b-4e85-b3a2-4b09eac4ecdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:52.104809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215cb33-749b-4e85-b3a2-4b09eac4ecdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:52.106239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215cb33-749b-4e85-b3a2-4b09eac4ecdd None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-3215cb33-749b-4e85-b3a2-4b09eac4ecdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:52.122721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:52.123789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:52.125309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:52.125309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:52.125309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:52.125309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:52.125309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 634/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:52.129658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ced3a-7989-4111-9cae-8d498ba49d1f None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:52.226261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ced3a-7989-4111-9cae-8d498ba49d1f None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:52.257943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c314-607d-4e6a-94d7-984dabbec5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:52.258584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c314-607d-4e6a-94d7-984dabbec5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:52.258892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c314-607d-4e6a-94d7-984dabbec5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:52.259170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c314-607d-4e6a-94d7-984dabbec5a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:52.259905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989c314-607d-4e6a-94d7-984dabbec5a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:52.260210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989c314-607d-4e6a-94d7-984dabbec5a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:52.261559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989c314-607d-4e6a-94d7-984dabbec5a6 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:52.276445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 645/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:52.282452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215cb33-749b-4e85-b3a2-4b09eac4ecdd None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:52.320872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:52.408314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215cb33-749b-4e85-b3a2-4b09eac4ecdd None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:52.441074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237eb60-d6d5-43c5-9799-227e7d38c431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:52.441870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237eb60-d6d5-43c5-9799-227e7d38c431 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:52.442152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237eb60-d6d5-43c5-9799-227e7d38c431 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:52.442429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237eb60-d6d5-43c5-9799-227e7d38c431 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:52.449596 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237eb60-d6d5-43c5-9799-227e7d38c431 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:52.451122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237eb60-d6d5-43c5-9799-227e7d38c431 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-1237eb60-d6d5-43c5-9799-227e7d38c431 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 17:57:52.465707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:52.466829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:52.467996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 635/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:52.472745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c314-607d-4e6a-94d7-984dabbec5a6 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:52.476487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:52.570115 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c314-607d-4e6a-94d7-984dabbec5a6 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:52.603060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73215373-0511-49ae-b45d-1f34376ec489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:52.603652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215373-0511-49ae-b45d-1f34376ec489 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:52.603935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215373-0511-49ae-b45d-1f34376ec489 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:52.604211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215373-0511-49ae-b45d-1f34376ec489 None admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:52.605032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73215373-0511-49ae-b45d-1f34376ec489 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:52.605346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73215373-0511-49ae-b45d-1f34376ec489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:52.606794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73215373-0511-49ae-b45d-1f34376ec489 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:52.630032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 646/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Mon May 23 17:57:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:52.637161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237eb60-d6d5-43c5-9799-227e7d38c431 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:52.728590 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:52.738755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237eb60-d6d5-43c5-9799-227e7d38c431 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:52.772016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdaf79-e5c0-43de-9c11-89c5a418cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:52.772659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdaf79-e5c0-43de-9c11-89c5a418cb12 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:52.772944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdaf79-e5c0-43de-9c11-89c5a418cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:52.773223 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdaf79-e5c0-43de-9c11-89c5a418cb12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:52.838422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdaf79-e5c0-43de-9c11-89c5a418cb12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:52.839914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdaf79-e5c0-43de-9c11-89c5a418cb12 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:52.925946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:52.936025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 636/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Mon May 23 17:57:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 17:57:52.942374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73215373-0511-49ae-b45d-1f34376ec489 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:53.005527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:53.042520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73215373-0511-49ae-b45d-1f34376ec489 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:53.075868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede8b21-3fa7-4796-9b71-e0e88f768e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:53.076642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede8b21-3fa7-4796-9b71-e0e88f768e96 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:53.076924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede8b21-3fa7-4796-9b71-e0e88f768e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:53.077196 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede8b21-3fa7-4796-9b71-e0e88f768e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:53.086892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede8b21-3fa7-4796-9b71-e0e88f768e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:53.088389 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede8b21-3fa7-4796-9b71-e0e88f768e96 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-5ede8b21-3fa7-4796-9b71-e0e88f768e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 17:57:53.105464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:53.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:53.107696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 17:57:53.107696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 17:57:53.107696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 17:57:53.107696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:53.107696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 647/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 17:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:53.113132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdaf79-e5c0-43de-9c11-89c5a418cb12 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:53.209899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdaf79-e5c0-43de-9c11-89c5a418cb12 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:53.243224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1185ae1-1404-4452-b9cb-5487bbe76ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:53.243868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1185ae1-1404-4452-b9cb-5487bbe76ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:53.244149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1185ae1-1404-4452-b9cb-5487bbe76ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:53.244423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1185ae1-1404-4452-b9cb-5487bbe76ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:53.245130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1185ae1-1404-4452-b9cb-5487bbe76ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:53.245434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1185ae1-1404-4452-b9cb-5487bbe76ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:53.246827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1185ae1-1404-4452-b9cb-5487bbe76ea6 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:53.258114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 637/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Mon May 23 17:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:53.264376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede8b21-3fa7-4796-9b71-e0e88f768e96 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:53.361882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede8b21-3fa7-4796-9b71-e0e88f768e96 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:53.375396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:53.395221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee7133-3830-49d3-bbf5-18478f087780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:53.395992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee7133-3830-49d3-bbf5-18478f087780 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:53.396275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee7133-3830-49d3-bbf5-18478f087780 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:53.396548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee7133-3830-49d3-bbf5-18478f087780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:53.402996 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee7133-3830-49d3-bbf5-18478f087780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:53.404422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee7133-3830-49d3-bbf5-18478f087780 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application [None req-1aee7133-3830-49d3-bbf5-18478f087780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 17:57:53.418441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application with Lock( May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:53.419492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:53.420498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 17:57:53.420498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 17:57:53.420498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 17:57:53.420498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 17:57:53.420498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 17:57:53.420498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 17:57:53.420498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 17:57:53.420498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: ERROR keystone.server.flask.application May 23 17:57:53.420498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 648/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Mon May 23 17:57:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:53.426363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1185ae1-1404-4452-b9cb-5487bbe76ea6 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:53.476785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:53.526483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1185ae1-1404-4452-b9cb-5487bbe76ea6 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:53.559236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438c994-ae26-44a2-8fde-e54cb95cc522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:53.559891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438c994-ae26-44a2-8fde-e54cb95cc522 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:53.560177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438c994-ae26-44a2-8fde-e54cb95cc522 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:53.560454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438c994-ae26-44a2-8fde-e54cb95cc522 None admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:53.561240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438c994-ae26-44a2-8fde-e54cb95cc522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:53.561547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438c994-ae26-44a2-8fde-e54cb95cc522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:53.563251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438c994-ae26-44a2-8fde-e54cb95cc522 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:53.574960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 638/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Mon May 23 17:57:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:53.581682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee7133-3830-49d3-bbf5-18478f087780 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:53.678785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee7133-3830-49d3-bbf5-18478f087780 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:53.711602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec6a98-4566-44c0-8f53-86fbf80b1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:53.712239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6a98-4566-44c0-8f53-86fbf80b1435 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:53.712526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6a98-4566-44c0-8f53-86fbf80b1435 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:53.712803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6a98-4566-44c0-8f53-86fbf80b1435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:53.713625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec6a98-4566-44c0-8f53-86fbf80b1435 None admin] RBAC: Adding query filter params (role.id=af8084c48e3c40298e26d44d6d14595a, scope.project.id=6640de800f74494888cbb47aa590456c, user.id=77e042a473204d358e3b0682bf1338d7) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:53.713937 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec6a98-4566-44c0-8f53-86fbf80b1435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:53.715406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec6a98-4566-44c0-8f53-86fbf80b1435 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:53.721226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 649/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Mon May 23 17:57:53 2022] GET /identity/v3/role_assignments?user.id=77e042a473204d358e3b0682bf1338d7&scope.project.id=6640de800f74494888cbb47aa590456c&role.id=af8084c48e3c40298e26d44d6d14595a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:55.937225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa173c7-d014-4aae-86e4-e3c0b68bff33 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:55.937762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa173c7-d014-4aae-86e4-e3c0b68bff33 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:55.937762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa173c7-d014-4aae-86e4-e3c0b68bff33 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:55.939193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 639/1288] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:57:55.944477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f880-8bed-4c6d-b6ea-47df61923566 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:55.944917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f880-8bed-4c6d-b6ea-47df61923566 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:55.945017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f880-8bed-4c6d-b6ea-47df61923566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:55.962130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cd71f880-8bed-4c6d-b6ea-47df61923566 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:57:55.963363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cd71f880-8bed-4c6d-b6ea-47df61923566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:57:55.996352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:56.034797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 650/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:57:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:57:56.056982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa173c7-d014-4aae-86e4-e3c0b68bff33 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:56.156139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa173c7-d014-4aae-86e4-e3c0b68bff33 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:56.166246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:56.189285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69101e-cdc0-43ac-a017-1bd007075c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:56.189999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69101e-cdc0-43ac-a017-1bd007075c57 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:56.190278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69101e-cdc0-43ac-a017-1bd007075c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:56.190552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69101e-cdc0-43ac-a017-1bd007075c57 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:56.191219 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69101e-cdc0-43ac-a017-1bd007075c57 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:56.192567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69101e-cdc0-43ac-a017-1bd007075c57 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-5f69101e-cdc0-43ac-a017-1bd007075c57 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:57:56.204565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:57:56.205751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:57:56.206968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 640/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Mon May 23 17:57:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:57:56.211625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71f880-8bed-4c6d-b6ea-47df61923566 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:56.313158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71f880-8bed-4c6d-b6ea-47df61923566 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:56.353091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf680f2d-00a7-4379-9655-e93c698523e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:56.354217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf680f2d-00a7-4379-9655-e93c698523e7 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:56.354588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf680f2d-00a7-4379-9655-e93c698523e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:56.354952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf680f2d-00a7-4379-9655-e93c698523e7 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:56.356148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf680f2d-00a7-4379-9655-e93c698523e7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:56.356585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf680f2d-00a7-4379-9655-e93c698523e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:56.358693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf680f2d-00a7-4379-9655-e93c698523e7 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:56.364915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 651/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Mon May 23 17:57:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:56.370798 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69101e-cdc0-43ac-a017-1bd007075c57 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:56.470560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69101e-cdc0-43ac-a017-1bd007075c57 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:56.504657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faddaf-9843-45c4-9fd9-a9a853fcdc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:56.505560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faddaf-9843-45c4-9fd9-a9a853fcdc0a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:56.505844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faddaf-9843-45c4-9fd9-a9a853fcdc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:56.506121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faddaf-9843-45c4-9fd9-a9a853fcdc0a None admin] PATH_INFO: `/v3/services` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:56.506846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3faddaf-9843-45c4-9fd9-a9a853fcdc0a None admin] RBAC: Adding query filter params (type=placement) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:57:56.507154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3faddaf-9843-45c4-9fd9-a9a853fcdc0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:56.508531 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3faddaf-9843-45c4-9fd9-a9a853fcdc0a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:56.513053 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 641/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Mon May 23 17:57:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:57:58.684815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598e546-203f-4dbc-be2c-68e3605772e4 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:58.685334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598e546-203f-4dbc-be2c-68e3605772e4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:58.685334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598e546-203f-4dbc-be2c-68e3605772e4 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:58.687345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 652/1293] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:57:58.692538 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e12113-ce7a-4202-a362-f98b7bf9fd45 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:58.692939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e12113-ce7a-4202-a362-f98b7bf9fd45 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:58.693089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e12113-ce7a-4202-a362-f98b7bf9fd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:58.710276 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-66e12113-ce7a-4202-a362-f98b7bf9fd45 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:57:58.711467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-66e12113-ce7a-4202-a362-f98b7bf9fd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:57:58.740279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:58.776958 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 642/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:57:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:57:58.800148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598e546-203f-4dbc-be2c-68e3605772e4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:57:58.830755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:57:58.899221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598e546-203f-4dbc-be2c-68e3605772e4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:57:58.931787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30fdfe-35cc-457d-8651-637c48f1d098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:57:58.932427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30fdfe-35cc-457d-8651-637c48f1d098 None admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:57:58.932708 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30fdfe-35cc-457d-8651-637c48f1d098 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:57:58.932984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30fdfe-35cc-457d-8651-637c48f1d098 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:57:58.933703 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30fdfe-35cc-457d-8651-637c48f1d098 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:57:58.935071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30fdfe-35cc-457d-8651-637c48f1d098 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:57:58.947421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 653/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Mon May 23 17:57:58 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:58:01.157531 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441d7f4-55f2-411e-93b3-b22f966af8fe None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:01.158062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441d7f4-55f2-411e-93b3-b22f966af8fe None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:01.158181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441d7f4-55f2-411e-93b3-b22f966af8fe None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:01.159500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 643/1296] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:58:01.164704 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e3902-dfb2-44a6-84c1-c17b1471df21 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:01.165124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e3902-dfb2-44a6-84c1-c17b1471df21 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:01.165262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e3902-dfb2-44a6-84c1-c17b1471df21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:01.181647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a97e3902-dfb2-44a6-84c1-c17b1471df21 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:58:01.182861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a97e3902-dfb2-44a6-84c1-c17b1471df21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:58:01.252830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 654/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:58:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:58:01.276227 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441d7f4-55f2-411e-93b3-b22f966af8fe None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:58:01.383279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441d7f4-55f2-411e-93b3-b22f966af8fe None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:58:01.416622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ee3af-e089-4d74-9633-fba5e81f633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:58:01.417333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ee3af-e089-4d74-9633-fba5e81f633a None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:01.417611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ee3af-e089-4d74-9633-fba5e81f633a None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:01.417878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ee3af-e089-4d74-9633-fba5e81f633a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:01.418515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ee3af-e089-4d74-9633-fba5e81f633a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:58:01.419907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ee3af-e089-4d74-9633-fba5e81f633a None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-f19ee3af-e089-4d74-9633-fba5e81f633a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:58:01.432214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:58:01.433386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:58:01.434257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 644/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Mon May 23 17:58:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:58:01.439745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e3902-dfb2-44a6-84c1-c17b1471df21 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:58:01.457255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:58:01.537898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e3902-dfb2-44a6-84c1-c17b1471df21 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:58:01.570676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fb625-d71b-466b-8765-344432f9b162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:58:01.571360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fb625-d71b-466b-8765-344432f9b162 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:01.571641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fb625-d71b-466b-8765-344432f9b162 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:01.571917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fb625-d71b-466b-8765-344432f9b162 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:01.572613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fb625-d71b-466b-8765-344432f9b162 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:58:01.572920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fb625-d71b-466b-8765-344432f9b162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:58:01.574273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fb625-d71b-466b-8765-344432f9b162 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:58:01.579357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 655/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Mon May 23 17:58:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:58:01.585376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ee3af-e089-4d74-9633-fba5e81f633a None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:58:01.616307 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:58:01.683726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ee3af-e089-4d74-9633-fba5e81f633a None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:58:01.715819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28b6b6-9384-41dd-9189-630f3e577936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:58:01.716457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28b6b6-9384-41dd-9189-630f3e577936 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:01.716740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28b6b6-9384-41dd-9189-630f3e577936 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:01.717019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28b6b6-9384-41dd-9189-630f3e577936 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:01.718310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28b6b6-9384-41dd-9189-630f3e577936 None admin] RBAC: Adding query filter params (interface=public, service_id=884f2eeb3e4f42bb8371c0cd6af9898c, region_id=RegionOne) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:58:01.718619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28b6b6-9384-41dd-9189-630f3e577936 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:58:01.720003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28b6b6-9384-41dd-9189-630f3e577936 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:58:01.724870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 645/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Mon May 23 17:58:01 2022] GET /identity/v3/endpoints?service_id=884f2eeb3e4f42bb8371c0cd6af9898c&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:58:01.730368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fb625-d71b-466b-8765-344432f9b162 None admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:58:01.809699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:58:01.828255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fb625-d71b-466b-8765-344432f9b162 None admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:58:01.861199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda25ca0-f74f-41a6-8c7c-63595375f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:58:01.861850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda25ca0-f74f-41a6-8c7c-63595375f480 None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:01.862131 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda25ca0-f74f-41a6-8c7c-63595375f480 None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:01.862402 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda25ca0-f74f-41a6-8c7c-63595375f480 None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:01.863106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda25ca0-f74f-41a6-8c7c-63595375f480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:58:01.864466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda25ca0-f74f-41a6-8c7c-63595375f480 None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:58:01.871199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 656/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Mon May 23 17:58:01 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 17:58:04.041294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b83f29-6bf9-49ba-b042-9106c248e464 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:04.041820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b83f29-6bf9-49ba-b042-9106c248e464 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:04.041915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b83f29-6bf9-49ba-b042-9106c248e464 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:04.043258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 646/1302] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:58:04.049366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11374ea6-12dc-4014-880d-ae37cde825d1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:04.049784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11374ea6-12dc-4014-880d-ae37cde825d1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:04.049922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11374ea6-12dc-4014-880d-ae37cde825d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:04.066307 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-11374ea6-12dc-4014-880d-ae37cde825d1 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:58:04.067500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-11374ea6-12dc-4014-880d-ae37cde825d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:58:04.132461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 657/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:58:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 17:58:04.156303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b83f29-6bf9-49ba-b042-9106c248e464 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:58:04.249503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:58:04.256773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b83f29-6bf9-49ba-b042-9106c248e464 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:58:04.288520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f0139-6fe4-41bd-834c-2c85544710d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:58:04.289335 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0139-6fe4-41bd-834c-2c85544710d8 None admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:04.289619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0139-6fe4-41bd-834c-2c85544710d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:04.289896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0139-6fe4-41bd-834c-2c85544710d8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:04.290536 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f0139-6fe4-41bd-834c-2c85544710d8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:58:04.291985 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f0139-6fe4-41bd-834c-2c85544710d8 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application [None req-fd8f0139-6fe4-41bd-834c-2c85544710d8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 17:58:04.304364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 17:58:04.305549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.get_or_create( May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application with Lock( May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self._enter() May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application return self.creator() May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application created_value = creator( May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: ERROR keystone.server.flask.application May 23 17:58:04.306468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 647/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Mon May 23 17:58:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 17:58:04.312234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11374ea6-12dc-4014-880d-ae37cde825d1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:58:04.385565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:58:04.408561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11374ea6-12dc-4014-880d-ae37cde825d1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:58:04.441263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ccf05-789d-42aa-9fc5-7d9fa57be86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:58:04.441898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ccf05-789d-42aa-9fc5-7d9fa57be86c None admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:04.442173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ccf05-789d-42aa-9fc5-7d9fa57be86c None admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:04.442443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ccf05-789d-42aa-9fc5-7d9fa57be86c None admin] PATH_INFO: `/v3/services` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:04.443160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ccf05-789d-42aa-9fc5-7d9fa57be86c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 17:58:04.443462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ccf05-789d-42aa-9fc5-7d9fa57be86c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:58:04.444823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ccf05-789d-42aa-9fc5-7d9fa57be86c None admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:58:04.449830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 658/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Mon May 23 17:58:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 17:58:04.455560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f0139-6fe4-41bd-834c-2c85544710d8 None admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:58:04.555140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f0139-6fe4-41bd-834c-2c85544710d8 None admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:58:04.587999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb0207-ea09-4cee-9ad3-a508cd717dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:58:04.588674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb0207-ea09-4cee-9ad3-a508cd717dc1 None admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:58:04.588954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb0207-ea09-4cee-9ad3-a508cd717dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:58:04.589225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb0207-ea09-4cee-9ad3-a508cd717dc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:58:04.589971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb0207-ea09-4cee-9ad3-a508cd717dc1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:58:04.591366 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb0207-ea09-4cee-9ad3-a508cd717dc1 None admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:58:04.609599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 648/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Mon May 23 17:58:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 17:58:14.447680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=30 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:58:14.605136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:08.625283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f12f4-33b4-43a6-817e-ad427c0f06d6 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:08.625865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f12f4-33b4-43a6-817e-ad427c0f06d6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:08.625865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f12f4-33b4-43a6-817e-ad427c0f06d6 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:08.627340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 659/1307] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:08.632779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb23ab-e7e2-4867-b835-09ea21cb0ea3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:08.633221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb23ab-e7e2-4867-b835-09ea21cb0ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:08.633448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb23ab-e7e2-4867-b835-09ea21cb0ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:08.714941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-efbb23ab-e7e2-4867-b835-09ea21cb0ea3 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:08.717442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-efbb23ab-e7e2-4867-b835-09ea21cb0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:08.962825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 649/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:09.007509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180a747-bf96-4110-9a5a-3815d6601fb9 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:09.007858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180a747-bf96-4110-9a5a-3815d6601fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:09.008140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180a747-bf96-4110-9a5a-3815d6601fb9 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:09.010394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 660/1309] 10.222.0.30 () {54 vars in 964 bytes} [Mon May 23 17:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:09.017615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894214b5-219e-4752-8def-ef71b5955707 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:09.017923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894214b5-219e-4752-8def-ef71b5955707 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:09.018175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894214b5-219e-4752-8def-ef71b5955707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:09.108393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-894214b5-219e-4752-8def-ef71b5955707 None None] MFA Rules not processed for user `a26055489c284bcf8f0d418e4afffe73`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:09.109992 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-894214b5-219e-4752-8def-ef71b5955707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:09.134384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:09.203424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 650/1310] 10.222.0.30 () {58 vars in 1061 bytes} [Mon May 23 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:09.212065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180a747-bf96-4110-9a5a-3815d6601fb9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:09.213920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c180a747-bf96-4110-9a5a-3815d6601fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:09.347772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180a747-bf96-4110-9a5a-3815d6601fb9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:09.433453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48d3cd-c408-4417-8860-8d3bc9d69fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:09.434499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48d3cd-c408-4417-8860-8d3bc9d69fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:09.435049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48d3cd-c408-4417-8860-8d3bc9d69fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:09.435727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48d3cd-c408-4417-8860-8d3bc9d69fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:09.437757 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7d48d3cd-c408-4417-8860-8d3bc9d69fc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:09.500028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:09.577368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48d3cd-c408-4417-8860-8d3bc9d69fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:09.579755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48d3cd-c408-4417-8860-8d3bc9d69fc3 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:09.606219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 661/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:12.276368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ab1e-e522-4c0f-b80b-316fe7fc4a96 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:12.276898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ab1e-e522-4c0f-b80b-316fe7fc4a96 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:12.276898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ab1e-e522-4c0f-b80b-316fe7fc4a96 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:12.278287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 651/1312] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:12.283472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cb35d-1db2-4f39-b8e3-fef1bb574e27 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:12.283885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cb35d-1db2-4f39-b8e3-fef1bb574e27 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:12.284031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cb35d-1db2-4f39-b8e3-fef1bb574e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:12.399361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-900cb35d-1db2-4f39-b8e3-fef1bb574e27 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:12.400573 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-900cb35d-1db2-4f39-b8e3-fef1bb574e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:12.504945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 662/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:12.542842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ab1e-e522-4c0f-b80b-316fe7fc4a96 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:12.544416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8c81ab1e-e522-4c0f-b80b-316fe7fc4a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:12.649835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ab1e-e522-4c0f-b80b-316fe7fc4a96 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:12.719743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:12.722605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9384c-42dc-471f-9ace-cd7692aa6cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:12.723465 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9384c-42dc-471f-9ace-cd7692aa6cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:12.723923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9384c-42dc-471f-9ace-cd7692aa6cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:12.724451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9384c-42dc-471f-9ace-cd7692aa6cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:12.726105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e4e9384c-42dc-471f-9ace-cd7692aa6cc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:12.833834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9384c-42dc-471f-9ace-cd7692aa6cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:12.835334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9384c-42dc-471f-9ace-cd7692aa6cc3 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:12.854633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 652/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:15.395336 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbeb517-ba55-460c-8081-6193e95c70fc None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:15.395871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbeb517-ba55-460c-8081-6193e95c70fc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:15.395871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbeb517-ba55-460c-8081-6193e95c70fc None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:15.397247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 663/1315] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:15.403184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7d450-8b46-43ee-8e81-555c3a711218 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:15.403586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7d450-8b46-43ee-8e81-555c3a711218 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:15.403727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7d450-8b46-43ee-8e81-555c3a711218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:15.468140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-65c7d450-8b46-43ee-8e81-555c3a711218 None None] MFA Rules not processed for user `0cf3f752e71f49dda8072b132321a74f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:15.469323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-65c7d450-8b46-43ee-8e81-555c3a711218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:15.523344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:15.567619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 653/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:15.607460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbeb517-ba55-460c-8081-6193e95c70fc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:15.608984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7dbeb517-ba55-460c-8081-6193e95c70fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:15.618649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:15.712726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbeb517-ba55-460c-8081-6193e95c70fc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:15.784982 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5bb44-88de-4a96-8b20-15372072b9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:15.785621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5bb44-88de-4a96-8b20-15372072b9af service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:15.785904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5bb44-88de-4a96-8b20-15372072b9af service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:15.786179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5bb44-88de-4a96-8b20-15372072b9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:15.787849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9cd5bb44-88de-4a96-8b20-15372072b9af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:15.848788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:15.895608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5bb44-88de-4a96-8b20-15372072b9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:15.897027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5bb44-88de-4a96-8b20-15372072b9af service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:15.914664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 664/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:18.691828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a81bcc-ef99-4468-a022-34cdbe948809 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:18.692359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a81bcc-ef99-4468-a022-34cdbe948809 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:18.692359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a81bcc-ef99-4468-a022-34cdbe948809 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:18.693775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 654/1318] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:18.699617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f362-99f5-44fd-ae1a-dcd17ff579b9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:18.700023 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f362-99f5-44fd-ae1a-dcd17ff579b9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:18.700164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f362-99f5-44fd-ae1a-dcd17ff579b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:18.765148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8b16f362-99f5-44fd-ae1a-dcd17ff579b9 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:18.766346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8b16f362-99f5-44fd-ae1a-dcd17ff579b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:18.859257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 665/1319] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:18.913238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820a915-0541-40a1-86d1-a15b6e4895e3 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:18.913520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820a915-0541-40a1-86d1-a15b6e4895e3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:18.913792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820a915-0541-40a1-86d1-a15b6e4895e3 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:18.915206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 655/1320] 10.222.0.30 () {54 vars in 964 bytes} [Mon May 23 17:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:18.921171 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786242aa-7420-4849-bd1a-caf83ecbe170 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:18.921460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786242aa-7420-4849-bd1a-caf83ecbe170 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:18.921739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786242aa-7420-4849-bd1a-caf83ecbe170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:18.942324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:18.997260 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-786242aa-7420-4849-bd1a-caf83ecbe170 None None] MFA Rules not processed for user `a26055489c284bcf8f0d418e4afffe73`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:18.998460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-786242aa-7420-4849-bd1a-caf83ecbe170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:19.073165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 666/1321] 10.222.0.30 () {58 vars in 1061 bytes} [Mon May 23 17:59:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:19.081688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820a915-0541-40a1-86d1-a15b6e4895e3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:19.083220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c820a915-0541-40a1-86d1-a15b6e4895e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:19.185896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820a915-0541-40a1-86d1-a15b6e4895e3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:19.257950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd2234-efcb-49a6-b21e-4482e37dab5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:19.258595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd2234-efcb-49a6-b21e-4482e37dab5d service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:19.258907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd2234-efcb-49a6-b21e-4482e37dab5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:19.259186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd2234-efcb-49a6-b21e-4482e37dab5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:19.260853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-53cd2234-efcb-49a6-b21e-4482e37dab5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:19.268217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:19.368511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd2234-efcb-49a6-b21e-4482e37dab5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:19.370670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd2234-efcb-49a6-b21e-4482e37dab5d service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:19.388736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 656/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:22.710226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4718-9629-4243-b6b0-88bb38fdc715 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:22.710767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4718-9629-4243-b6b0-88bb38fdc715 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:22.710882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4718-9629-4243-b6b0-88bb38fdc715 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:22.712242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 667/1323] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:22.717901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a09f5-d36c-445d-92c7-5860370f9197 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:22.718344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a09f5-d36c-445d-92c7-5860370f9197 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:22.718490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a09f5-d36c-445d-92c7-5860370f9197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:22.782722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2f1a09f5-d36c-445d-92c7-5860370f9197 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:22.783906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2f1a09f5-d36c-445d-92c7-5860370f9197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:22.841404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:22.882925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 657/1324] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:22.919242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4718-9629-4243-b6b0-88bb38fdc715 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:22.920769 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e8de4718-9629-4243-b6b0-88bb38fdc715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:23.024157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4718-9629-4243-b6b0-88bb38fdc715 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:23.036955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:23.100248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bca819-8153-47c3-b50d-72a397b03e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:23.100893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bca819-8153-47c3-b50d-72a397b03e73 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:23.101179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bca819-8153-47c3-b50d-72a397b03e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:23.101456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bca819-8153-47c3-b50d-72a397b03e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:23.103257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-93bca819-8153-47c3-b50d-72a397b03e73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:23.230090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bca819-8153-47c3-b50d-72a397b03e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:23.231514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bca819-8153-47c3-b50d-72a397b03e73 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:23.253356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 668/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:25.550342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3374c1d-df1d-498e-8765-800908484242 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:25.550880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3374c1d-df1d-498e-8765-800908484242 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:25.551013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3374c1d-df1d-498e-8765-800908484242 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:25.552315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 658/1326] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:25.557620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ded0e-401d-4f3b-adc1-820b2b2c1147 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:25.558034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ded0e-401d-4f3b-adc1-820b2b2c1147 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:25.558242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ded0e-401d-4f3b-adc1-820b2b2c1147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:25.605028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:25.623686 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b14ded0e-401d-4f3b-adc1-820b2b2c1147 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:25.624927 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b14ded0e-401d-4f3b-adc1-820b2b2c1147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:25.727304 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 669/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:25.764788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3374c1d-df1d-498e-8765-800908484242 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:25.766343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e3374c1d-df1d-498e-8765-800908484242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:25.868749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3374c1d-df1d-498e-8765-800908484242 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:25.940996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cdf23-89e2-453c-a1dd-2270478c00e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:25.941672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cdf23-89e2-453c-a1dd-2270478c00e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:25.941963 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cdf23-89e2-453c-a1dd-2270478c00e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:25.942241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cdf23-89e2-453c-a1dd-2270478c00e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:25.943913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8f1cdf23-89e2-453c-a1dd-2270478c00e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:25.961621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:26.060412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cdf23-89e2-453c-a1dd-2270478c00e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:26.061868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cdf23-89e2-453c-a1dd-2270478c00e7 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:26.080962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 659/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:28.377696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e220d-7467-4624-8b43-1baed191e96b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:28.378241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e220d-7467-4624-8b43-1baed191e96b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:28.378241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e220d-7467-4624-8b43-1baed191e96b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:28.379919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 670/1329] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:28.385221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dea7ca-9bfa-4866-9343-bf83f9f79117 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:28.385785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dea7ca-9bfa-4866-9343-bf83f9f79117 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:28.385889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dea7ca-9bfa-4866-9343-bf83f9f79117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:28.451039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-67dea7ca-9bfa-4866-9343-bf83f9f79117 None None] MFA Rules not processed for user `0cf3f752e71f49dda8072b132321a74f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:28.452161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-67dea7ca-9bfa-4866-9343-bf83f9f79117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:28.519194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:28.555786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 660/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:28.592333 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e220d-7467-4624-8b43-1baed191e96b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:28.593858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d68e220d-7467-4624-8b43-1baed191e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:28.699153 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e220d-7467-4624-8b43-1baed191e96b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:28.719916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:28.774233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf533af-be14-4f2c-b5ec-730b1ec723aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:28.774902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf533af-be14-4f2c-b5ec-730b1ec723aa service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:28.775181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf533af-be14-4f2c-b5ec-730b1ec723aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:28.775450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf533af-be14-4f2c-b5ec-730b1ec723aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:28.777658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-acf533af-be14-4f2c-b5ec-730b1ec723aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:28.883932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf533af-be14-4f2c-b5ec-730b1ec723aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:28.885903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf533af-be14-4f2c-b5ec-730b1ec723aa service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:28.904004 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 671/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:31.361326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ba37-732a-4d6a-8e1e-13b991fdabe6 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:31.361875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ba37-732a-4d6a-8e1e-13b991fdabe6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:31.361875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ba37-732a-4d6a-8e1e-13b991fdabe6 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:31.363266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 661/1332] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:31.368344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d4c2-2ac4-49ec-b25f-7b190690590c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:31.368734 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d4c2-2ac4-49ec-b25f-7b190690590c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:31.368907 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d4c2-2ac4-49ec-b25f-7b190690590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:31.433582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:31.436355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6ee4d4c2-2ac4-49ec-b25f-7b190690590c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:31.438071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6ee4d4c2-2ac4-49ec-b25f-7b190690590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:31.539679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 672/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:31.575865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11ba37-732a-4d6a-8e1e-13b991fdabe6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:31.577380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7b11ba37-732a-4d6a-8e1e-13b991fdabe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:31.686133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11ba37-732a-4d6a-8e1e-13b991fdabe6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:31.761731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac2f30-1a72-4e30-a1a1-438e36b39344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:31.762391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2f30-1a72-4e30-a1a1-438e36b39344 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:31.762676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2f30-1a72-4e30-a1a1-438e36b39344 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:31.762979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac2f30-1a72-4e30-a1a1-438e36b39344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:31.764678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-41ac2f30-1a72-4e30-a1a1-438e36b39344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:31.794724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:31.883693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac2f30-1a72-4e30-a1a1-438e36b39344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:31.885301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac2f30-1a72-4e30-a1a1-438e36b39344 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:31.904186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 662/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:34.148670 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e2c9-a840-4cff-a8fa-4f21aed31231 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:34.149210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e2c9-a840-4cff-a8fa-4f21aed31231 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:34.149210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e2c9-a840-4cff-a8fa-4f21aed31231 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:34.150580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 673/1335] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:34.155656 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a9d5c-5582-43d9-9a10-71fdda5b09b7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:34.156083 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a9d5c-5582-43d9-9a10-71fdda5b09b7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:34.156275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a9d5c-5582-43d9-9a10-71fdda5b09b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:34.221277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d17a9d5c-5582-43d9-9a10-71fdda5b09b7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:34.222474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d17a9d5c-5582-43d9-9a10-71fdda5b09b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:34.296531 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:34.319275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 663/1336] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:34.358647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e2c9-a840-4cff-a8fa-4f21aed31231 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:34.360263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1904e2c9-a840-4cff-a8fa-4f21aed31231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:34.462413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e2c9-a840-4cff-a8fa-4f21aed31231 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:34.490718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:34.540913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac63cc-4e8d-4083-baae-dc17e216a116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:34.542125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac63cc-4e8d-4083-baae-dc17e216a116 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:34.542492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac63cc-4e8d-4083-baae-dc17e216a116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:34.542800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac63cc-4e8d-4083-baae-dc17e216a116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:34.544430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-91ac63cc-4e8d-4083-baae-dc17e216a116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:34.652210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac63cc-4e8d-4083-baae-dc17e216a116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:34.653652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac63cc-4e8d-4083-baae-dc17e216a116 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:34.672217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 674/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:37.284638 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ee203-7ccb-46ce-9854-85082b6f1a0a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:37.285292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ee203-7ccb-46ce-9854-85082b6f1a0a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:37.285292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ee203-7ccb-46ce-9854-85082b6f1a0a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:37.286576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 664/1338] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:37.293910 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0383-3811-43bc-80a2-8744d144410c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:37.294399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0383-3811-43bc-80a2-8744d144410c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:37.294504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0383-3811-43bc-80a2-8744d144410c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:37.365645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bb2e0383-3811-43bc-80a2-8744d144410c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:37.366935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bb2e0383-3811-43bc-80a2-8744d144410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:37.376138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:37.475866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 675/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:37.511859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ee203-7ccb-46ce-9854-85082b6f1a0a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:37.513445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-123ee203-7ccb-46ce-9854-85082b6f1a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:37.615614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ee203-7ccb-46ce-9854-85082b6f1a0a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:37.691595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208efba7-6601-4071-a5a4-0c5a835aa6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:37.692247 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208efba7-6601-4071-a5a4-0c5a835aa6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:37.692529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208efba7-6601-4071-a5a4-0c5a835aa6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:37.692792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208efba7-6601-4071-a5a4-0c5a835aa6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:37.694416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-208efba7-6601-4071-a5a4-0c5a835aa6b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:37.730539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:37.804263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208efba7-6601-4071-a5a4-0c5a835aa6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:37.805705 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208efba7-6601-4071-a5a4-0c5a835aa6b7 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:37.823997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 665/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:42.137666 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27898de6-c8ea-4c42-9d0b-9ed849230357 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:42.138195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27898de6-c8ea-4c42-9d0b-9ed849230357 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:42.138195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27898de6-c8ea-4c42-9d0b-9ed849230357 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:42.139663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 676/1341] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:42.144930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672bbc4-11d8-498f-be72-0997579eb401 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:42.145319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672bbc4-11d8-498f-be72-0997579eb401 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:42.145497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672bbc4-11d8-498f-be72-0997579eb401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:42.232766 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a672bbc4-11d8-498f-be72-0997579eb401 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:42.233969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a672bbc4-11d8-498f-be72-0997579eb401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:42.328048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:42.341254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 666/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:42.380743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27898de6-c8ea-4c42-9d0b-9ed849230357 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:42.382997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-27898de6-c8ea-4c42-9d0b-9ed849230357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:42.480156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27898de6-c8ea-4c42-9d0b-9ed849230357 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:42.483747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcdaca-69dd-4472-8437-d58a60db9743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:42.484438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcdaca-69dd-4472-8437-d58a60db9743 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:42.484724 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcdaca-69dd-4472-8437-d58a60db9743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:42.485003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcdaca-69dd-4472-8437-d58a60db9743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:42.494346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcdaca-69dd-4472-8437-d58a60db9743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:42.496940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcdaca-69dd-4472-8437-d58a60db9743 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:42.510363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 677/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:45.290765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d246-65f0-4437-adc0-9d994aab9ea6 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:45.291814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d246-65f0-4437-adc0-9d994aab9ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:45.291814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d246-65f0-4437-adc0-9d994aab9ea6 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:45.293112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 667/1344] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:45.298164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213396c9-0856-4d9e-9300-53736a90fcdc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:45.298572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213396c9-0856-4d9e-9300-53736a90fcdc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:45.298746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213396c9-0856-4d9e-9300-53736a90fcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:45.331552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-213396c9-0856-4d9e-9300-53736a90fcdc None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:45.332990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-213396c9-0856-4d9e-9300-53736a90fcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:45.364976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:45.417043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 678/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:45.453465 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480d246-65f0-4437-adc0-9d994aab9ea6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:45.464218 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480d246-65f0-4437-adc0-9d994aab9ea6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:45.467735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446446f-a7ab-4fd0-aaa7-a7828cc0771e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:45.468379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446446f-a7ab-4fd0-aaa7-a7828cc0771e service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:45.468663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446446f-a7ab-4fd0-aaa7-a7828cc0771e service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:45.468939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446446f-a7ab-4fd0-aaa7-a7828cc0771e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:45.478257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446446f-a7ab-4fd0-aaa7-a7828cc0771e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:45.480292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446446f-a7ab-4fd0-aaa7-a7828cc0771e service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:45.489698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 668/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:49.710758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105566-85e2-4405-9549-f47324d1d8be None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:49.711227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105566-85e2-4405-9549-f47324d1d8be None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:49.711429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105566-85e2-4405-9549-f47324d1d8be None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:49.714000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 679/1347] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 17:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:49.719126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932840-0559-4ab1-b333-25328b877bd5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:49.719587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932840-0559-4ab1-b333-25328b877bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:49.719774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932840-0559-4ab1-b333-25328b877bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:49.737826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-77932840-0559-4ab1-b333-25328b877bd5 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:49.739064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-77932840-0559-4ab1-b333-25328b877bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:49.747841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 669/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 17:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:49.785257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62105566-85e2-4405-9549-f47324d1d8be None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 17:59:49.796878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62105566-85e2-4405-9549-f47324d1d8be None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 17:59:49.800381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfb64a-1f4b-4d0a-87a9-ccdee7b8799f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 17:59:49.801018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfb64a-1f4b-4d0a-87a9-ccdee7b8799f service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:49.801306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfb64a-1f4b-4d0a-87a9-ccdee7b8799f service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:49.801584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfb64a-1f4b-4d0a-87a9-ccdee7b8799f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:49.811477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfb64a-1f4b-4d0a-87a9-ccdee7b8799f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 17:59:49.812940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfb64a-1f4b-4d0a-87a9-ccdee7b8799f service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 17:59:49.822347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 680/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 17:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 17:59:55.260662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82710782-46e7-4df9-b75d-35b259f80627 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:55.261748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82710782-46e7-4df9-b75d-35b259f80627 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:55.262181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82710782-46e7-4df9-b75d-35b259f80627 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:55.264622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 670/1350] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 17:59:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:55.269971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb4818-db8b-47c8-823f-8a705437f38b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:55.270803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb4818-db8b-47c8-823f-8a705437f38b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:55.271258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb4818-db8b-47c8-823f-8a705437f38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:55.371993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1ccb4818-db8b-47c8-823f-8a705437f38b None None] MFA Rules not processed for user `77e042a473204d358e3b0682bf1338d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:55.373529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1ccb4818-db8b-47c8-823f-8a705437f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:55.490383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 681/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 17:59:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 17:59:59.699746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8cbe7-124a-41e4-8573-88209eb6f269 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:59.700264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8cbe7-124a-41e4-8573-88209eb6f269 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:59.700377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8cbe7-124a-41e4-8573-88209eb6f269 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:59.701984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 671/1352] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 17:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 17:59:59.707112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08833881-6f44-4030-9ecd-7908220072f4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 17:59:59.707516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08833881-6f44-4030-9ecd-7908220072f4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 17:59:59.707747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08833881-6f44-4030-9ecd-7908220072f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 17:59:59.726782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-08833881-6f44-4030-9ecd-7908220072f4 None None] MFA Rules not processed for user `77e042a473204d358e3b0682bf1338d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 17:59:59.728125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-08833881-6f44-4030-9ecd-7908220072f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 17:59:59.732505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=13 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 17:59:59.738133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 682/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:01.202106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b31fc-4961-435b-af15-c6dad1147266 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:01.202644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b31fc-4961-435b-af15-c6dad1147266 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:01.202644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b31fc-4961-435b-af15-c6dad1147266 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:01.204202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 672/1354] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 18:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:01.208848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d46b2-5345-4e4e-8795-630d0fbe0f83 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:01.209365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d46b2-5345-4e4e-8795-630d0fbe0f83 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:01.209471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d46b2-5345-4e4e-8795-630d0fbe0f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:01.227755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7c7d46b2-5345-4e4e-8795-630d0fbe0f83 None None] MFA Rules not processed for user `77e042a473204d358e3b0682bf1338d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:01.228952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7c7d46b2-5345-4e4e-8795-630d0fbe0f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:01.237485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 683/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 18:00:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:05.129322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419dae-b94e-4d0b-ac35-30e30f644456 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:05.130192 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419dae-b94e-4d0b-ac35-30e30f644456 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:05.130756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419dae-b94e-4d0b-ac35-30e30f644456 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:05.132302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 673/1356] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:05.137768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43d032-fa13-4c9a-b9f0-b3f1c6018bda None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:05.138217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43d032-fa13-4c9a-b9f0-b3f1c6018bda None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:05.138369 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43d032-fa13-4c9a-b9f0-b3f1c6018bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:05.158928 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1e43d032-fa13-4c9a-b9f0-b3f1c6018bda None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:05.160464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1e43d032-fa13-4c9a-b9f0-b3f1c6018bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:05.170764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 684/1357] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:05.223557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451c68a-a00b-45d0-83ca-48dae05317ea None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:05.224259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451c68a-a00b-45d0-83ca-48dae05317ea None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:05.224988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451c68a-a00b-45d0-83ca-48dae05317ea None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:05.227170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 674/1358] 10.222.0.30 () {54 vars in 961 bytes} [Mon May 23 18:00:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:05.237422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d975dbf-3ccf-4a7b-8c45-6a8100604e53 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:05.237711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d975dbf-3ccf-4a7b-8c45-6a8100604e53 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:05.237984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d975dbf-3ccf-4a7b-8c45-6a8100604e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:05.284641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:05.294803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0d975dbf-3ccf-4a7b-8c45-6a8100604e53 None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:05.295985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0d975dbf-3ccf-4a7b-8c45-6a8100604e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:05.394562 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 685/1359] 10.222.0.30 () {58 vars in 1058 bytes} [Mon May 23 18:00:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:00:05.395891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451c68a-a00b-45d0-83ca-48dae05317ea None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:05.412976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451c68a-a00b-45d0-83ca-48dae05317ea None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:05.419501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25a2fd-15ba-4fad-97dd-f0116607d903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:05.420240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25a2fd-15ba-4fad-97dd-f0116607d903 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:05.420599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25a2fd-15ba-4fad-97dd-f0116607d903 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:05.420955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25a2fd-15ba-4fad-97dd-f0116607d903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:05.430838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25a2fd-15ba-4fad-97dd-f0116607d903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:05.433148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25a2fd-15ba-4fad-97dd-f0116607d903 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:05.445112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 675/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:07.899436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae4a58-18aa-406a-bb92-96ab44f5cdc5 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:07.900329 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae4a58-18aa-406a-bb92-96ab44f5cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:07.900788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae4a58-18aa-406a-bb92-96ab44f5cdc5 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:07.902328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 686/1361] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:07.907593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d06e7-346a-4576-99e1-c6ba373432c3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:07.908037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d06e7-346a-4576-99e1-c6ba373432c3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:07.908136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d06e7-346a-4576-99e1-c6ba373432c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:07.926347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ef0d06e7-346a-4576-99e1-c6ba373432c3 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:07.927538 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ef0d06e7-346a-4576-99e1-c6ba373432c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:07.936106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 676/1362] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:07.980006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae4a58-18aa-406a-bb92-96ab44f5cdc5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:07.997284 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae4a58-18aa-406a-bb92-96ab44f5cdc5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:08.002956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cb44e-03df-44e3-bccb-53a0518c44aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:08.003601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb44e-03df-44e3-bccb-53a0518c44aa service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:08.003880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb44e-03df-44e3-bccb-53a0518c44aa service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:08.004152 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb44e-03df-44e3-bccb-53a0518c44aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:08.014225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cb44e-03df-44e3-bccb-53a0518c44aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:08.016558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cb44e-03df-44e3-bccb-53a0518c44aa service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:08.027057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 687/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:10.602552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5076bac-e3c8-48d1-8e22-ceb682c51928 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:10.603066 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5076bac-e3c8-48d1-8e22-ceb682c51928 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:10.603175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5076bac-e3c8-48d1-8e22-ceb682c51928 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:10.605447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 677/1364] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:10.610650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b042-9975-4208-b871-e1c0f335cbc5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:10.611068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b042-9975-4208-b871-e1c0f335cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:10.611436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b042-9975-4208-b871-e1c0f335cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:10.632054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-15c5b042-9975-4208-b871-e1c0f335cbc5 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:10.633501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-15c5b042-9975-4208-b871-e1c0f335cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:10.658935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 688/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:10.697898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4ca9f-6d0c-44df-9a91-9e298bc3caf1 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:10.698358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4ca9f-6d0c-44df-9a91-9e298bc3caf1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:10.698640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4ca9f-6d0c-44df-9a91-9e298bc3caf1 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:10.700099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 678/1366] 10.222.0.30 () {54 vars in 961 bytes} [Mon May 23 18:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:10.705682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214d748-e251-4271-bb41-84c2cee5772d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:10.706000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214d748-e251-4271-bb41-84c2cee5772d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:10.706280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214d748-e251-4271-bb41-84c2cee5772d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:10.724936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a214d748-e251-4271-bb41-84c2cee5772d None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:10.726037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a214d748-e251-4271-bb41-84c2cee5772d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:10.735794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 689/1367] 10.222.0.30 () {58 vars in 1058 bytes} [Mon May 23 18:00:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:00:10.743439 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4ca9f-6d0c-44df-9a91-9e298bc3caf1 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:10.758858 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4ca9f-6d0c-44df-9a91-9e298bc3caf1 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:10.765129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f535f5d-6a72-4d00-9cfd-e98a468648bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:10.765781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f535f5d-6a72-4d00-9cfd-e98a468648bd service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:10.766051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f535f5d-6a72-4d00-9cfd-e98a468648bd service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:10.766327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f535f5d-6a72-4d00-9cfd-e98a468648bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:10.774345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f535f5d-6a72-4d00-9cfd-e98a468648bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:10.776519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f535f5d-6a72-4d00-9cfd-e98a468648bd service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:10.786040 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 679/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:13.099353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08695f98-f18c-4a72-8724-7a243081cca0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:13.099903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08695f98-f18c-4a72-8724-7a243081cca0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:13.099903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08695f98-f18c-4a72-8724-7a243081cca0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:13.101250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 690/1369] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:13.107150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630859-00ab-4365-8531-18e9c4adac71 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:13.107612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630859-00ab-4365-8531-18e9c4adac71 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:13.107706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630859-00ab-4365-8531-18e9c4adac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:13.126447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7f630859-00ab-4365-8531-18e9c4adac71 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:13.127665 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7f630859-00ab-4365-8531-18e9c4adac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:13.135948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 680/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:13.178333 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08695f98-f18c-4a72-8724-7a243081cca0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:13.193617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08695f98-f18c-4a72-8724-7a243081cca0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:13.199128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd461a3-e16d-4feb-a0df-53d3158b1925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:13.199766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd461a3-e16d-4feb-a0df-53d3158b1925 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:13.200044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd461a3-e16d-4feb-a0df-53d3158b1925 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:13.200317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd461a3-e16d-4feb-a0df-53d3158b1925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:13.208936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd461a3-e16d-4feb-a0df-53d3158b1925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:13.210526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd461a3-e16d-4feb-a0df-53d3158b1925 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:13.221174 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 691/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:13.424326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd534-12ed-4648-80b2-5c44c8e8c6c3 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:13.424625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd534-12ed-4648-80b2-5c44c8e8c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:13.424906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd534-12ed-4648-80b2-5c44c8e8c6c3 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:13.426309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 681/1372] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:13.432574 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9186-6cde-46f8-8be3-fbab21753ab7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:13.432863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9186-6cde-46f8-8be3-fbab21753ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:13.433158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9186-6cde-46f8-8be3-fbab21753ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:13.453064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-224a9186-6cde-46f8-8be3-fbab21753ab7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:13.454340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-224a9186-6cde-46f8-8be3-fbab21753ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:13.463582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 692/1373] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:13.773903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bed7f-b7d5-4729-b5b7-7251df2c287c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:13.774258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bed7f-b7d5-4729-b5b7-7251df2c287c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:13.774601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bed7f-b7d5-4729-b5b7-7251df2c287c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:13.776921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 682/1374] 10.222.0.30 () {54 vars in 963 bytes} [Mon May 23 18:00:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:13.782940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5415c8-4ccc-4ac6-87e7-847c79c3376a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:13.783313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5415c8-4ccc-4ac6-87e7-847c79c3376a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:13.783662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5415c8-4ccc-4ac6-87e7-847c79c3376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:13.835964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5c5415c8-4ccc-4ac6-87e7-847c79c3376a None None] MFA Rules not processed for user `e8eae73572d54dcaac9f3f6bb24df316`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:13.837400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5c5415c8-4ccc-4ac6-87e7-847c79c3376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:13.901967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 693/1375] 10.222.0.30 () {58 vars in 1060 bytes} [Mon May 23 18:00:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:13.912121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bed7f-b7d5-4729-b5b7-7251df2c287c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:13.928166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bed7f-b7d5-4729-b5b7-7251df2c287c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:13.932365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06277257-5427-4a5e-95da-141562aca478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:13.933612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06277257-5427-4a5e-95da-141562aca478 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:13.933966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06277257-5427-4a5e-95da-141562aca478 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:13.934309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06277257-5427-4a5e-95da-141562aca478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:13.944084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06277257-5427-4a5e-95da-141562aca478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:13.945602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06277257-5427-4a5e-95da-141562aca478 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:13.956790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 683/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:15.625659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b17876-37a9-4f3a-82c7-be1d5f0ef773 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:15.626214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b17876-37a9-4f3a-82c7-be1d5f0ef773 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:15.626214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b17876-37a9-4f3a-82c7-be1d5f0ef773 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:15.627572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 694/1377] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:15.635828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7cbd3-5a18-454a-9cc5-811329ff8ae4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:15.636316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7cbd3-5a18-454a-9cc5-811329ff8ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:15.636710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7cbd3-5a18-454a-9cc5-811329ff8ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:15.657469 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-08f7cbd3-5a18-454a-9cc5-811329ff8ae4 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:15.658855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-08f7cbd3-5a18-454a-9cc5-811329ff8ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:15.667314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 684/1378] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:15.723414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b17876-37a9-4f3a-82c7-be1d5f0ef773 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:15.738834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b17876-37a9-4f3a-82c7-be1d5f0ef773 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:15.744857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca3d9d-cf87-4e91-8e6e-ce4a018fabb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:15.745644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3d9d-cf87-4e91-8e6e-ce4a018fabb5 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:15.746000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3d9d-cf87-4e91-8e6e-ce4a018fabb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:15.746296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3d9d-cf87-4e91-8e6e-ce4a018fabb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:15.756211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca3d9d-cf87-4e91-8e6e-ce4a018fabb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:15.757850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca3d9d-cf87-4e91-8e6e-ce4a018fabb5 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:15.763695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:15.771103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 695/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:18.190070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b6dd-f7c4-4b51-9d34-475be61ec870 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:18.190639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b6dd-f7c4-4b51-9d34-475be61ec870 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:18.190639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b6dd-f7c4-4b51-9d34-475be61ec870 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:18.192063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 685/1380] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:18.197520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03a037-c0ee-4f40-9736-0594458f526f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:18.198331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03a037-c0ee-4f40-9736-0594458f526f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:18.198615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03a037-c0ee-4f40-9736-0594458f526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:18.217156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0e03a037-c0ee-4f40-9736-0594458f526f None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:18.218503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0e03a037-c0ee-4f40-9736-0594458f526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:18.230730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 696/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:18.289279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b6dd-f7c4-4b51-9d34-475be61ec870 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:18.306264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b6dd-f7c4-4b51-9d34-475be61ec870 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:18.313049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33628df4-8c30-43cf-9615-95de4064e1d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:18.313809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33628df4-8c30-43cf-9615-95de4064e1d4 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:18.314190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33628df4-8c30-43cf-9615-95de4064e1d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:18.314565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33628df4-8c30-43cf-9615-95de4064e1d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:18.325547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33628df4-8c30-43cf-9615-95de4064e1d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:18.327389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33628df4-8c30-43cf-9615-95de4064e1d4 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:18.339701 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 686/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:20.816849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29780b-879c-41f2-838b-9fb48602e1b2 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:20.817405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29780b-879c-41f2-838b-9fb48602e1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:20.817496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29780b-879c-41f2-838b-9fb48602e1b2 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:20.818893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 697/1383] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:20.824881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156a40f-80c1-453a-a91b-8ef5ec7040fb None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:20.825441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156a40f-80c1-453a-a91b-8ef5ec7040fb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:20.825441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156a40f-80c1-453a-a91b-8ef5ec7040fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:20.845616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d156a40f-80c1-453a-a91b-8ef5ec7040fb None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:20.846902 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d156a40f-80c1-453a-a91b-8ef5ec7040fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:20.863726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 687/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:20.908980 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29780b-879c-41f2-838b-9fb48602e1b2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:20.928869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29780b-879c-41f2-838b-9fb48602e1b2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:20.934559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184186cc-91f6-43ba-8616-757199edc4ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:20.935327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184186cc-91f6-43ba-8616-757199edc4ee service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:20.935673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184186cc-91f6-43ba-8616-757199edc4ee service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:20.936034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184186cc-91f6-43ba-8616-757199edc4ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:20.944903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184186cc-91f6-43ba-8616-757199edc4ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:20.946564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184186cc-91f6-43ba-8616-757199edc4ee service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:20.956951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 698/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:23.178331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed38d-b27c-4bd3-b68e-315779bd5976 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:23.179100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed38d-b27c-4bd3-b68e-315779bd5976 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:23.179100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed38d-b27c-4bd3-b68e-315779bd5976 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:23.180421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 688/1386] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:23.186105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e1ce1-89a9-4ce0-acfb-929236c506dc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:23.186635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e1ce1-89a9-4ce0-acfb-929236c506dc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:23.186635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e1ce1-89a9-4ce0-acfb-929236c506dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:23.205150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fa5e1ce1-89a9-4ce0-acfb-929236c506dc None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:23.206345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fa5e1ce1-89a9-4ce0-acfb-929236c506dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:23.217083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 699/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:23.261766 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed38d-b27c-4bd3-b68e-315779bd5976 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:23.276432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed38d-b27c-4bd3-b68e-315779bd5976 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:23.282060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2ebff-ee97-4231-89ed-dc90cc30c980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:23.282720 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2ebff-ee97-4231-89ed-dc90cc30c980 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:23.283010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2ebff-ee97-4231-89ed-dc90cc30c980 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:23.283280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2ebff-ee97-4231-89ed-dc90cc30c980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:23.291830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2ebff-ee97-4231-89ed-dc90cc30c980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:23.293396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2ebff-ee97-4231-89ed-dc90cc30c980 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:23.303042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 689/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:25.599150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d61e41-f5f4-4a78-b074-6b1f701875e5 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:25.599868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d61e41-f5f4-4a78-b074-6b1f701875e5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:25.599868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d61e41-f5f4-4a78-b074-6b1f701875e5 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:25.601134 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 700/1389] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:25.607440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dd06-6ee2-4d54-bc2f-c199e89e6186 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:25.607893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dd06-6ee2-4d54-bc2f-c199e89e6186 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:25.608000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dd06-6ee2-4d54-bc2f-c199e89e6186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:25.626110 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9b18dd06-6ee2-4d54-bc2f-c199e89e6186 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:25.627332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9b18dd06-6ee2-4d54-bc2f-c199e89e6186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:25.636082 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 690/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:25.684917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d61e41-f5f4-4a78-b074-6b1f701875e5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:25.701147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d61e41-f5f4-4a78-b074-6b1f701875e5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:25.706792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820d973-834c-4f6e-97f4-2716989a951d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:25.707436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820d973-834c-4f6e-97f4-2716989a951d service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:25.707721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820d973-834c-4f6e-97f4-2716989a951d service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:25.708055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820d973-834c-4f6e-97f4-2716989a951d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:25.717621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820d973-834c-4f6e-97f4-2716989a951d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:25.719298 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820d973-834c-4f6e-97f4-2716989a951d service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:25.730128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 701/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:28.184349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fb70b-01bf-4cd8-bb69-d95e0b131364 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:28.185014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fb70b-01bf-4cd8-bb69-d95e0b131364 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:28.185014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fb70b-01bf-4cd8-bb69-d95e0b131364 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:28.186276 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 691/1392] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:28.191544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db103741-89f3-4e15-a572-a996f0f3a8ad None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:28.192006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db103741-89f3-4e15-a572-a996f0f3a8ad None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:28.192128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db103741-89f3-4e15-a572-a996f0f3a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:28.210160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-db103741-89f3-4e15-a572-a996f0f3a8ad None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:28.211383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-db103741-89f3-4e15-a572-a996f0f3a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:28.220248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 702/1393] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:28.264146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fb70b-01bf-4cd8-bb69-d95e0b131364 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:28.279501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fb70b-01bf-4cd8-bb69-d95e0b131364 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:28.284877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b627724-acbe-4e1e-a98e-911fcd3f423f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:28.285525 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627724-acbe-4e1e-a98e-911fcd3f423f service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:28.285811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627724-acbe-4e1e-a98e-911fcd3f423f service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:28.286089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627724-acbe-4e1e-a98e-911fcd3f423f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:28.294727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b627724-acbe-4e1e-a98e-911fcd3f423f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:28.296306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b627724-acbe-4e1e-a98e-911fcd3f423f service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:28.305713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 692/1394] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:30.081802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dbcd9-7bb4-4c7e-b741-ee6705a4d5e7 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:30.082373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dbcd9-7bb4-4c7e-b741-ee6705a4d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:30.082373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dbcd9-7bb4-4c7e-b741-ee6705a4d5e7 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:30.083752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 703/1395] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:30.089640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c48844-0ff1-495d-9b93-48ced72d065d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:30.090289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c48844-0ff1-495d-9b93-48ced72d065d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:30.090289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c48844-0ff1-495d-9b93-48ced72d065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:30.096239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=52 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:30.110184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-89c48844-0ff1-495d-9b93-48ced72d065d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:30.111429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-89c48844-0ff1-495d-9b93-48ced72d065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:30.119464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 693/1396] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:30.174647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb42eec-f322-4dec-9879-47973913194d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:30.174968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb42eec-f322-4dec-9879-47973913194d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:30.175241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb42eec-f322-4dec-9879-47973913194d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:30.176615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 704/1397] 10.222.0.30 () {54 vars in 962 bytes} [Mon May 23 18:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:30.181827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0daff6-123a-4b03-bcaa-a3cadea763cf None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:30.182121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0daff6-123a-4b03-bcaa-a3cadea763cf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:30.182410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0daff6-123a-4b03-bcaa-a3cadea763cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:30.231017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4f0daff6-123a-4b03-bcaa-a3cadea763cf None None] MFA Rules not processed for user `a2a5d7aee47e43e9904a93c6ce3bb412`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:30.232218 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4f0daff6-123a-4b03-bcaa-a3cadea763cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:30.292717 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 694/1398] 10.222.0.30 () {58 vars in 1059 bytes} [Mon May 23 18:00:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:30.300217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb42eec-f322-4dec-9879-47973913194d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:30.310877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb42eec-f322-4dec-9879-47973913194d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:30.314621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33389e39-fb2b-4945-8f9c-7c106aca0ace service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a5d7aee47e43e9904a93c6ce3bb412', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:30.315366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33389e39-fb2b-4945-8f9c-7c106aca0ace service glance] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:30.315654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33389e39-fb2b-4945-8f9c-7c106aca0ace service glance] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:30.316014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33389e39-fb2b-4945-8f9c-7c106aca0ace service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:30.327148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33389e39-fb2b-4945-8f9c-7c106aca0ace service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:30.328573 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33389e39-fb2b-4945-8f9c-7c106aca0ace service glance] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:30.338483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 705/1399] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:30.554289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0bf3-8099-4053-a9b7-0ce740df354c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:30.556459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0bf3-8099-4053-a9b7-0ce740df354c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:30.556918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0bf3-8099-4053-a9b7-0ce740df354c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:30.558419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 695/1400] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:30.564068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585e8d7-8ed1-4428-8355-ce792c27f957 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:30.564431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585e8d7-8ed1-4428-8355-ce792c27f957 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:30.564784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585e8d7-8ed1-4428-8355-ce792c27f957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:30.583862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0585e8d7-8ed1-4428-8355-ce792c27f957 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:30.585227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0585e8d7-8ed1-4428-8355-ce792c27f957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:30.600097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 706/1401] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:30.644848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0bf3-8099-4053-a9b7-0ce740df354c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:30.662472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0bf3-8099-4053-a9b7-0ce740df354c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:30.668373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954b139-0ec9-4b40-ab50-8e86ddb6a722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:30.669076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b139-0ec9-4b40-ab50-8e86ddb6a722 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:30.669368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b139-0ec9-4b40-ab50-8e86ddb6a722 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:30.669648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b139-0ec9-4b40-ab50-8e86ddb6a722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:30.678416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954b139-0ec9-4b40-ab50-8e86ddb6a722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:30.680068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954b139-0ec9-4b40-ab50-8e86ddb6a722 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:30.690593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 696/1402] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:30.890128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabefad-091f-4177-afb8-bb2517d8dbda None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:30.890425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabefad-091f-4177-afb8-bb2517d8dbda None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:30.890759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabefad-091f-4177-afb8-bb2517d8dbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:30.942910 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1eabefad-091f-4177-afb8-bb2517d8dbda None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:30.944120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1eabefad-091f-4177-afb8-bb2517d8dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:31.009166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 707/1403] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:00:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:31.058000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a965c7-3b1f-4ae4-b646-70b8ac531147 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:31.058371 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a965c7-3b1f-4ae4-b646-70b8ac531147 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:31.058649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a965c7-3b1f-4ae4-b646-70b8ac531147 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:31.060059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 697/1404] 10.222.0.30 () {54 vars in 942 bytes} [Mon May 23 18:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:31.067949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58ca37-3bb8-4ede-b4a1-b9a64f08ec2d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:31.068248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58ca37-3bb8-4ede-b4a1-b9a64f08ec2d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:31.068533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58ca37-3bb8-4ede-b4a1-b9a64f08ec2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:31.119967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3a58ca37-3bb8-4ede-b4a1-b9a64f08ec2d None None] MFA Rules not processed for user `fcbd7035e027494cb063489b375cb385`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:31.121179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3a58ca37-3bb8-4ede-b4a1-b9a64f08ec2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:31.153589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:31.193251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 708/1405] 10.222.0.30 () {58 vars in 1039 bytes} [Mon May 23 18:00:31 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:31.203178 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a965c7-3b1f-4ae4-b646-70b8ac531147 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:31.216389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a965c7-3b1f-4ae4-b646-70b8ac531147 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:31.221256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278cc41-6a4c-48da-a17d-c0ebd10eeeb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:31.221886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278cc41-6a4c-48da-a17d-c0ebd10eeeb5 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:31.222166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278cc41-6a4c-48da-a17d-c0ebd10eeeb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:31.222438 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278cc41-6a4c-48da-a17d-c0ebd10eeeb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:31.231339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278cc41-6a4c-48da-a17d-c0ebd10eeeb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:31.232944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278cc41-6a4c-48da-a17d-c0ebd10eeeb5 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:31.241175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 698/1406] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:00:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:00:32.981722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd569f-4f0d-43af-98d6-76e49bd5d4ec None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:32.982264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd569f-4f0d-43af-98d6-76e49bd5d4ec None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:32.982548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd569f-4f0d-43af-98d6-76e49bd5d4ec None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:32.990746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 709/1407] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:00:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:32.993356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a62210-bda2-4ef9-8ee1-f71910b5b01a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:32.993825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a62210-bda2-4ef9-8ee1-f71910b5b01a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:32.994324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a62210-bda2-4ef9-8ee1-f71910b5b01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:33.028707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a2a62210-bda2-4ef9-8ee1-f71910b5b01a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:33.030300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a2a62210-bda2-4ef9-8ee1-f71910b5b01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:33.049477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 699/1408] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:33.117194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd569f-4f0d-43af-98d6-76e49bd5d4ec None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:33.132258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd569f-4f0d-43af-98d6-76e49bd5d4ec None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:33.137796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec571f-4aae-4842-b6d5-aa85044016f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:33.138445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec571f-4aae-4842-b6d5-aa85044016f5 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:33.138941 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec571f-4aae-4842-b6d5-aa85044016f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:33.139410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec571f-4aae-4842-b6d5-aa85044016f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:33.150140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec571f-4aae-4842-b6d5-aa85044016f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:33.152434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec571f-4aae-4842-b6d5-aa85044016f5 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:33.162861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 710/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:43.019050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=55 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:43.158127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=21 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:00:54.757924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4bd07-fd90-4cb2-ad40-e8cc17e7d0eb None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:54.758559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4bd07-fd90-4cb2-ad40-e8cc17e7d0eb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:54.758559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4bd07-fd90-4cb2-ad40-e8cc17e7d0eb None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:54.760542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 700/1410] 10.222.0.30 () {54 vars in 918 bytes} [Mon May 23 18:00:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:54.765590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2dd0c-7bb3-4a9e-8bdd-6453319a90f0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:54.766081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2dd0c-7bb3-4a9e-8bdd-6453319a90f0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:54.766189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2dd0c-7bb3-4a9e-8bdd-6453319a90f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:54.783841 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-58b2dd0c-7bb3-4a9e-8bdd-6453319a90f0 None None] MFA Rules not processed for user `77e042a473204d358e3b0682bf1338d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:54.784957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-58b2dd0c-7bb3-4a9e-8bdd-6453319a90f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:54.793375 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 711/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Mon May 23 18:00:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:54.807932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8823e7-cee1-447c-a5b2-023186690a72 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:54.808224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8823e7-cee1-447c-a5b2-023186690a72 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:54.808528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8823e7-cee1-447c-a5b2-023186690a72 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:54.809852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 701/1412] 10.222.0.30 () {54 vars in 918 bytes} [Mon May 23 18:00:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:54.814495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7c9f-078e-4d0d-bd73-11051cbc917e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:54.814822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7c9f-078e-4d0d-bd73-11051cbc917e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:54.815111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7c9f-078e-4d0d-bd73-11051cbc917e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:54.833127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-686d7c9f-078e-4d0d-bd73-11051cbc917e None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:54.834308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-686d7c9f-078e-4d0d-bd73-11051cbc917e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:54.843787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 712/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Mon May 23 18:00:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:57.504359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66615586-c575-44e5-9224-b9690fd982c9 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:57.504905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66615586-c575-44e5-9224-b9690fd982c9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:57.504905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66615586-c575-44e5-9224-b9690fd982c9 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:57.506242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:57.511917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57f11-6656-4c1a-b6a7-c70556077606 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:57.512400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57f11-6656-4c1a-b6a7-c70556077606 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:57.512661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57f11-6656-4c1a-b6a7-c70556077606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:57.530453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-62f57f11-6656-4c1a-b6a7-c70556077606 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:57.531689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-62f57f11-6656-4c1a-b6a7-c70556077606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:57.539481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:57.582353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66615586-c575-44e5-9224-b9690fd982c9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:57.596967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66615586-c575-44e5-9224-b9690fd982c9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:57.602231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6788ced-8262-4079-8311-97e5bd84f477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:57.602884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788ced-8262-4079-8311-97e5bd84f477 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:57.603663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788ced-8262-4079-8311-97e5bd84f477 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:57.604170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788ced-8262-4079-8311-97e5bd84f477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:57.612144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6788ced-8262-4079-8311-97e5bd84f477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:57.613707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6788ced-8262-4079-8311-97e5bd84f477 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:57.623853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 703/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:58.616543 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ac18-a3af-4ca3-971f-a531e2a986fc None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:58.617079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ac18-a3af-4ca3-971f-a531e2a986fc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:58.617079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ac18-a3af-4ca3-971f-a531e2a986fc None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:58.618467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:58.624070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16552d-3cbc-4429-b486-7577fc01748f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:58.624514 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16552d-3cbc-4429-b486-7577fc01748f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:58.624622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16552d-3cbc-4429-b486-7577fc01748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:58.643646 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1a16552d-3cbc-4429-b486-7577fc01748f None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:58.644854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1a16552d-3cbc-4429-b486-7577fc01748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:58.653070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:00:58.836166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30ac18-a3af-4ca3-971f-a531e2a986fc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:00:58.850446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30ac18-a3af-4ca3-971f-a531e2a986fc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:00:58.856690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820cf37-6220-47a2-a20b-02a6b214396a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:00:58.857317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820cf37-6220-47a2-a20b-02a6b214396a service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:58.857594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820cf37-6220-47a2-a20b-02a6b214396a service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:58.857863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820cf37-6220-47a2-a20b-02a6b214396a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:58.865949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820cf37-6220-47a2-a20b-02a6b214396a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:00:58.867566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820cf37-6220-47a2-a20b-02a6b214396a service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:00:58.877613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 715/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:00:59.817087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e60f3-faa6-424a-af45-bb9355f74e8f None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:59.817620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e60f3-faa6-424a-af45-bb9355f74e8f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:59.817620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e60f3-faa6-424a-af45-bb9355f74e8f None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:59.818984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:00:59.824052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d314-5c07-442e-8d67-a13b1b349bf9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:00:59.824486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d314-5c07-442e-8d67-a13b1b349bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:00:59.824617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d314-5c07-442e-8d67-a13b1b349bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:00:59.842427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c986d314-5c07-442e-8d67-a13b1b349bf9 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:00:59.843654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c986d314-5c07-442e-8d67-a13b1b349bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:00:59.851647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:01:00.002891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e60f3-faa6-424a-af45-bb9355f74e8f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:00.017364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e60f3-faa6-424a-af45-bb9355f74e8f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:00.022560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba113b-93b1-41e4-ba7e-5a6f55b87ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:00.023224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba113b-93b1-41e4-ba7e-5a6f55b87ed1 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:00.023506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba113b-93b1-41e4-ba7e-5a6f55b87ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:00.023772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba113b-93b1-41e4-ba7e-5a6f55b87ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:00.032316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba113b-93b1-41e4-ba7e-5a6f55b87ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:00.033943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba113b-93b1-41e4-ba7e-5a6f55b87ed1 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:00.043857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 706/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:00.958831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf360490-7860-4652-8008-d9a2f01a06d8 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:00.959397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf360490-7860-4652-8008-d9a2f01a06d8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:00.959397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf360490-7860-4652-8008-d9a2f01a06d8 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:00.960769 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:00.965945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5eac6-49dc-474d-bfa7-3dc93422915b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:00.966404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5eac6-49dc-474d-bfa7-3dc93422915b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:00.966512 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5eac6-49dc-474d-bfa7-3dc93422915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:00.984832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c6d5eac6-49dc-474d-bfa7-3dc93422915b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:00.986016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c6d5eac6-49dc-474d-bfa7-3dc93422915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:00.994294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:01.143673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf360490-7860-4652-8008-d9a2f01a06d8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:01.158055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf360490-7860-4652-8008-d9a2f01a06d8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:01.163680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d0985-b490-4940-bd83-b68d25831aba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:01.164316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d0985-b490-4940-bd83-b68d25831aba service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:01.164599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d0985-b490-4940-bd83-b68d25831aba service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:01.164875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d0985-b490-4940-bd83-b68d25831aba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:01.173694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d0985-b490-4940-bd83-b68d25831aba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:01.175342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d0985-b490-4940-bd83-b68d25831aba service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:01.185477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 718/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:02.097716 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1eeb9-b5de-4270-ae9e-2d16b647119a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:02.098255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1eeb9-b5de-4270-ae9e-2d16b647119a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:02.098255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1eeb9-b5de-4270-ae9e-2d16b647119a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:02.099713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:02.104877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b456131-d9e9-4b82-a31c-bc295bd2a44c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:02.105318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b456131-d9e9-4b82-a31c-bc295bd2a44c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:02.105468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b456131-d9e9-4b82-a31c-bc295bd2a44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:02.124002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9b456131-d9e9-4b82-a31c-bc295bd2a44c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:02.125208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9b456131-d9e9-4b82-a31c-bc295bd2a44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:02.133279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:02.283983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1eeb9-b5de-4270-ae9e-2d16b647119a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:02.298399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1eeb9-b5de-4270-ae9e-2d16b647119a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:02.303672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcca9e1-2df1-4568-acf3-ea4b710f90fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:02.304301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcca9e1-2df1-4568-acf3-ea4b710f90fc service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:02.304583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcca9e1-2df1-4568-acf3-ea4b710f90fc service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:02.304856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcca9e1-2df1-4568-acf3-ea4b710f90fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:02.313652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcca9e1-2df1-4568-acf3-ea4b710f90fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:02.315246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcca9e1-2df1-4568-acf3-ea4b710f90fc service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:02.325896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 709/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:03.194685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcf117-1bc8-454c-bd3a-33c21812238f None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:03.195292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcf117-1bc8-454c-bd3a-33c21812238f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:03.195292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcf117-1bc8-454c-bd3a-33c21812238f None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:03.196618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:03.201476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f7817-a23a-4465-9841-737830620d04 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:03.201887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f7817-a23a-4465-9841-737830620d04 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:03.202029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f7817-a23a-4465-9841-737830620d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:03.219973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2e0f7817-a23a-4465-9841-737830620d04 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:03.221160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2e0f7817-a23a-4465-9841-737830620d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:03.229537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:01:03.379368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcf117-1bc8-454c-bd3a-33c21812238f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:03.394168 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcf117-1bc8-454c-bd3a-33c21812238f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:03.399514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7170a-d295-4d27-b001-0aae5a32101b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:03.400762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7170a-d295-4d27-b001-0aae5a32101b service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:03.401041 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7170a-d295-4d27-b001-0aae5a32101b service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:03.401317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7170a-d295-4d27-b001-0aae5a32101b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:03.409308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7170a-d295-4d27-b001-0aae5a32101b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:03.410906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7170a-d295-4d27-b001-0aae5a32101b service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:03.420177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 721/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:04.277162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7531e-abc0-4571-9da0-5b6c00afd544 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:04.277705 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7531e-abc0-4571-9da0-5b6c00afd544 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:04.277705 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7531e-abc0-4571-9da0-5b6c00afd544 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:04.279118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:04.284087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad8da-e322-4b50-88a1-11330478ddb8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:04.284532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad8da-e322-4b50-88a1-11330478ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:04.284654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad8da-e322-4b50-88a1-11330478ddb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:04.303508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9ecad8da-e322-4b50-88a1-11330478ddb8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:04.304696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9ecad8da-e322-4b50-88a1-11330478ddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:04.313094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:01:04.463644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7531e-abc0-4571-9da0-5b6c00afd544 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:04.478946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7531e-abc0-4571-9da0-5b6c00afd544 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:04.484318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c107c-f25c-4c9f-a71c-c641930782b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:04.484986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c107c-f25c-4c9f-a71c-c641930782b7 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:04.485270 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c107c-f25c-4c9f-a71c-c641930782b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:04.485547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c107c-f25c-4c9f-a71c-c641930782b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:04.493598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c107c-f25c-4c9f-a71c-c641930782b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:04.495284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c107c-f25c-4c9f-a71c-c641930782b7 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:04.504500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 712/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:05.352469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368f323-d534-4276-b315-b032e2b9d78b None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:05.353031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368f323-d534-4276-b315-b032e2b9d78b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:05.353426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368f323-d534-4276-b315-b032e2b9d78b None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:05.354866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:05.359909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfef75-7ec5-41cf-ba8a-11a037c36156 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:05.360366 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfef75-7ec5-41cf-ba8a-11a037c36156 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:05.360464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfef75-7ec5-41cf-ba8a-11a037c36156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:05.378773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9ccfef75-7ec5-41cf-ba8a-11a037c36156 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:05.380012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9ccfef75-7ec5-41cf-ba8a-11a037c36156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:05.388904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:05.539493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368f323-d534-4276-b315-b032e2b9d78b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:05.554168 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368f323-d534-4276-b315-b032e2b9d78b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:05.560332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a87b32-7bb5-4fb3-8aa8-95b34eac1265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:05.560953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87b32-7bb5-4fb3-8aa8-95b34eac1265 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:05.561312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87b32-7bb5-4fb3-8aa8-95b34eac1265 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:05.561611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87b32-7bb5-4fb3-8aa8-95b34eac1265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:05.569892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a87b32-7bb5-4fb3-8aa8-95b34eac1265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:05.571563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a87b32-7bb5-4fb3-8aa8-95b34eac1265 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:05.581401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 724/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:06.427781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498340-f7ef-483e-8805-b4884b3643b3 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:06.428361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498340-f7ef-483e-8805-b4884b3643b3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:06.428361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498340-f7ef-483e-8805-b4884b3643b3 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:06.429680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:06.434762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b06cb-35ba-4910-86b1-7f44af832f49 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:06.435190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b06cb-35ba-4910-86b1-7f44af832f49 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:06.435326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b06cb-35ba-4910-86b1-7f44af832f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:06.453445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7c4b06cb-35ba-4910-86b1-7f44af832f49 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:06.454648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7c4b06cb-35ba-4910-86b1-7f44af832f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:06.463032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:06.609910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498340-f7ef-483e-8805-b4884b3643b3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:06.624516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498340-f7ef-483e-8805-b4884b3643b3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:06.629850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed3482-1436-4308-8492-c6c053b68957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:06.630480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3482-1436-4308-8492-c6c053b68957 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:06.630805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3482-1436-4308-8492-c6c053b68957 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:06.631081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3482-1436-4308-8492-c6c053b68957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:06.640240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed3482-1436-4308-8492-c6c053b68957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:06.641827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed3482-1436-4308-8492-c6c053b68957 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:06.651804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 715/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:08.752261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c56f4-ac43-423d-bcef-f6aa6e532ed0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:08.752768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c56f4-ac43-423d-bcef-f6aa6e532ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:08.752861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c56f4-ac43-423d-bcef-f6aa6e532ed0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:08.754242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:08.760323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101f675-7d4b-4c6b-8858-2f0286e93143 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:08.760730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101f675-7d4b-4c6b-8858-2f0286e93143 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:08.760886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101f675-7d4b-4c6b-8858-2f0286e93143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:08.779099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6101f675-7d4b-4c6b-8858-2f0286e93143 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:08.780233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6101f675-7d4b-4c6b-8858-2f0286e93143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:08.787978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:08.825270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c56f4-ac43-423d-bcef-f6aa6e532ed0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:08.835850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c56f4-ac43-423d-bcef-f6aa6e532ed0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:08.839972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da54cc-58e3-4968-bdfd-0c88d1b9eafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:08.840601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da54cc-58e3-4968-bdfd-0c88d1b9eafa service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:08.840882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da54cc-58e3-4968-bdfd-0c88d1b9eafa service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:08.841155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da54cc-58e3-4968-bdfd-0c88d1b9eafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:08.849800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da54cc-58e3-4968-bdfd-0c88d1b9eafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:08.851281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da54cc-58e3-4968-bdfd-0c88d1b9eafa service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:08.860398 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 727/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:11.236918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160804-e13d-49fe-8aa1-0b0247fe4de5 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:11.237478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160804-e13d-49fe-8aa1-0b0247fe4de5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:11.237478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160804-e13d-49fe-8aa1-0b0247fe4de5 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:11.238888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:11.244617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2fe7f-bd1c-47ed-b0dd-5d47dc657bdc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:11.245180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2fe7f-bd1c-47ed-b0dd-5d47dc657bdc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:11.245674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2fe7f-bd1c-47ed-b0dd-5d47dc657bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:11.263532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6ec2fe7f-bd1c-47ed-b0dd-5d47dc657bdc None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:11.264724 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6ec2fe7f-bd1c-47ed-b0dd-5d47dc657bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:11.272392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:11.310330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21160804-e13d-49fe-8aa1-0b0247fe4de5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:11.321059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21160804-e13d-49fe-8aa1-0b0247fe4de5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:11.325024 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acff1c1-5775-4391-802c-6062f62b137e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:11.325662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acff1c1-5775-4391-802c-6062f62b137e service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:11.325953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acff1c1-5775-4391-802c-6062f62b137e service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:11.326230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acff1c1-5775-4391-802c-6062f62b137e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:11.335255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acff1c1-5775-4391-802c-6062f62b137e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:11.336684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acff1c1-5775-4391-802c-6062f62b137e service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:11.346591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 718/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:13.836123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de7ff-c505-4486-95e0-8226d03a9f91 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:13.836649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de7ff-c505-4486-95e0-8226d03a9f91 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:13.836649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de7ff-c505-4486-95e0-8226d03a9f91 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:13.838742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:13.844150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483578b2-2a70-4c18-b1f8-0a374c93b58b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:13.844549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483578b2-2a70-4c18-b1f8-0a374c93b58b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:13.844716 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483578b2-2a70-4c18-b1f8-0a374c93b58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:13.862948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-483578b2-2a70-4c18-b1f8-0a374c93b58b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:13.864140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-483578b2-2a70-4c18-b1f8-0a374c93b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:13.871922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:13.910756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de7ff-c505-4486-95e0-8226d03a9f91 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:13.912414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-494de7ff-c505-4486-95e0-8226d03a9f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:13.925200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de7ff-c505-4486-95e0-8226d03a9f91 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:13.928636 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40558e-53c1-4fac-8a61-b5dc416cca7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:13.929261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40558e-53c1-4fac-8a61-b5dc416cca7a service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:13.929539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40558e-53c1-4fac-8a61-b5dc416cca7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:13.929813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40558e-53c1-4fac-8a61-b5dc416cca7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:13.938788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40558e-53c1-4fac-8a61-b5dc416cca7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:13.940195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40558e-53c1-4fac-8a61-b5dc416cca7a service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:13.949896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 730/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:16.305217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0e93a-5b10-4aa3-9e6e-a0504b36cbef None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:16.305822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0e93a-5b10-4aa3-9e6e-a0504b36cbef None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:16.305822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0e93a-5b10-4aa3-9e6e-a0504b36cbef None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:16.307231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:16.312431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7b85-31e1-4938-a3c4-953ed62f6ff1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:16.312902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7b85-31e1-4938-a3c4-953ed62f6ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:16.313013 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7b85-31e1-4938-a3c4-953ed62f6ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:16.331287 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-46ba7b85-31e1-4938-a3c4-953ed62f6ff1 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:16.332484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-46ba7b85-31e1-4938-a3c4-953ed62f6ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:16.340912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:16.378265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0e93a-5b10-4aa3-9e6e-a0504b36cbef None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:16.389738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0e93a-5b10-4aa3-9e6e-a0504b36cbef None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:16.393372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc2adc-2179-454a-9401-680918cd2821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:16.394012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2adc-2179-454a-9401-680918cd2821 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:16.394295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2adc-2179-454a-9401-680918cd2821 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:16.394566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc2adc-2179-454a-9401-680918cd2821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:16.403575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc2adc-2179-454a-9401-680918cd2821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:16.404997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc2adc-2179-454a-9401-680918cd2821 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:16.414165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 721/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:18.693756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f3f10-7436-4843-bd37-386d72e968d0 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:18.694155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f3f10-7436-4843-bd37-386d72e968d0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:18.694306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f3f10-7436-4843-bd37-386d72e968d0 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:18.695728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:18.702409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada1911-e2fd-4fbb-86c6-251e560f3685 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:18.702888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada1911-e2fd-4fbb-86c6-251e560f3685 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:18.703039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada1911-e2fd-4fbb-86c6-251e560f3685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:18.721267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7ada1911-e2fd-4fbb-86c6-251e560f3685 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:18.722490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7ada1911-e2fd-4fbb-86c6-251e560f3685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:18.730339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:18.768888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f3f10-7436-4843-bd37-386d72e968d0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:18.779485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f3f10-7436-4843-bd37-386d72e968d0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:18.782866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26cbb5-9302-4b0a-b550-5129b9b83461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:18.783494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26cbb5-9302-4b0a-b550-5129b9b83461 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:18.783773 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26cbb5-9302-4b0a-b550-5129b9b83461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:18.784045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26cbb5-9302-4b0a-b550-5129b9b83461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:18.792789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26cbb5-9302-4b0a-b550-5129b9b83461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:18.794188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26cbb5-9302-4b0a-b550-5129b9b83461 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:18.803330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 733/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:21.054289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dda597-ee60-49df-b2be-1b451d6c0d2e None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:21.054884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dda597-ee60-49df-b2be-1b451d6c0d2e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:21.054884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dda597-ee60-49df-b2be-1b451d6c0d2e None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:21.056799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:21.062396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a80f-0f01-4c20-ae12-08b33ffac504 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:21.062894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a80f-0f01-4c20-ae12-08b33ffac504 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:21.063012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a80f-0f01-4c20-ae12-08b33ffac504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:21.080721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e7a5a80f-0f01-4c20-ae12-08b33ffac504 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:21.081942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e7a5a80f-0f01-4c20-ae12-08b33ffac504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:21.091357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:21.128559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dda597-ee60-49df-b2be-1b451d6c0d2e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:21.140119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dda597-ee60-49df-b2be-1b451d6c0d2e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:21.143579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f037a6f-adaa-4d9e-afdf-1896d503303e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:21.144208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f037a6f-adaa-4d9e-afdf-1896d503303e service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:21.144488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f037a6f-adaa-4d9e-afdf-1896d503303e service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:21.144759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f037a6f-adaa-4d9e-afdf-1896d503303e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:21.153534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f037a6f-adaa-4d9e-afdf-1896d503303e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:21.154977 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f037a6f-adaa-4d9e-afdf-1896d503303e service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:21.164084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 724/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:23.410911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0759d48-263b-4495-ada5-a86978511a03 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:23.411510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0759d48-263b-4495-ada5-a86978511a03 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:23.411510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0759d48-263b-4495-ada5-a86978511a03 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:23.412866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:23.418559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90a900-e16a-420b-90a3-435238a4897f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:23.418997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90a900-e16a-420b-90a3-435238a4897f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:23.419155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90a900-e16a-420b-90a3-435238a4897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:23.425149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=70 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:01:23.437535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8a90a900-e16a-420b-90a3-435238a4897f None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:23.438747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8a90a900-e16a-420b-90a3-435238a4897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:23.446462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:23.483294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0759d48-263b-4495-ada5-a86978511a03 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:23.488938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=73 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:01:23.495905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0759d48-263b-4495-ada5-a86978511a03 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:23.499366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e023a0-fbc0-4c33-8870-ee49cbd41e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:23.499993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e023a0-fbc0-4c33-8870-ee49cbd41e23 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:23.500271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e023a0-fbc0-4c33-8870-ee49cbd41e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:23.500548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e023a0-fbc0-4c33-8870-ee49cbd41e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:23.510224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e023a0-fbc0-4c33-8870-ee49cbd41e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:23.511743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e023a0-fbc0-4c33-8870-ee49cbd41e23 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:23.521261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 736/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:25.761588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f75ea-b49d-41a9-a93e-256bdf9ac520 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:25.762190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f75ea-b49d-41a9-a93e-256bdf9ac520 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:25.762190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f75ea-b49d-41a9-a93e-256bdf9ac520 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:25.763548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:25.768959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efd438-9fc2-4d86-94e1-a93678880395 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:25.769366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efd438-9fc2-4d86-94e1-a93678880395 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:25.769564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efd438-9fc2-4d86-94e1-a93678880395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:25.789711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-45efd438-9fc2-4d86-94e1-a93678880395 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:25.791173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-45efd438-9fc2-4d86-94e1-a93678880395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:25.799726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:25.837780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f75ea-b49d-41a9-a93e-256bdf9ac520 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:25.848350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f75ea-b49d-41a9-a93e-256bdf9ac520 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:25.851817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b4694-4d3c-4480-a3c2-0a0136260386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:25.852444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b4694-4d3c-4480-a3c2-0a0136260386 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:25.852751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b4694-4d3c-4480-a3c2-0a0136260386 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:25.853028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b4694-4d3c-4480-a3c2-0a0136260386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:25.861701 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b4694-4d3c-4480-a3c2-0a0136260386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:25.863157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b4694-4d3c-4480-a3c2-0a0136260386 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:25.872427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 727/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:28.093282 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c63814-1383-40f7-835c-6e2915ad35dd None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:28.093818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c63814-1383-40f7-835c-6e2915ad35dd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:28.093818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c63814-1383-40f7-835c-6e2915ad35dd None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:28.095258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:28.100651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eb633-e563-45e4-aad3-5df337ee579a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:28.101066 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eb633-e563-45e4-aad3-5df337ee579a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:28.101186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eb633-e563-45e4-aad3-5df337ee579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:28.118790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d78eb633-e563-45e4-aad3-5df337ee579a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:28.119798 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d78eb633-e563-45e4-aad3-5df337ee579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:28.127323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:28.164733 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c63814-1383-40f7-835c-6e2915ad35dd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:28.175420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c63814-1383-40f7-835c-6e2915ad35dd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:28.178938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797229-147b-4c0e-a4ed-b1d0c2e894b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:28.179572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797229-147b-4c0e-a4ed-b1d0c2e894b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:28.179855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797229-147b-4c0e-a4ed-b1d0c2e894b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:28.180130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797229-147b-4c0e-a4ed-b1d0c2e894b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:28.189158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce797229-147b-4c0e-a4ed-b1d0c2e894b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:28.190579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce797229-147b-4c0e-a4ed-b1d0c2e894b4 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:28.202083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 739/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:30.442025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb8083-02d5-4d8c-ad4b-93cc5f0e9eb9 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:30.442621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb8083-02d5-4d8c-ad4b-93cc5f0e9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:30.442621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb8083-02d5-4d8c-ad4b-93cc5f0e9eb9 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:30.443991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:01:30.450344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a026e7-fc27-4163-af9d-e6f8670a4df5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:30.450797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a026e7-fc27-4163-af9d-e6f8670a4df5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:30.450931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a026e7-fc27-4163-af9d-e6f8670a4df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:30.468867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-20a026e7-fc27-4163-af9d-e6f8670a4df5 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:01:30.470057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-20a026e7-fc27-4163-af9d-e6f8670a4df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:01:30.478340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:01:30.514529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb8083-02d5-4d8c-ad4b-93cc5f0e9eb9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:01:30.525392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb8083-02d5-4d8c-ad4b-93cc5f0e9eb9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:01:30.528904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670666f9-1d52-4e93-b8e3-6c37fd4c7dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:01:30.529544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670666f9-1d52-4e93-b8e3-6c37fd4c7dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:01:30.529829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670666f9-1d52-4e93-b8e3-6c37fd4c7dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:01:30.530105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670666f9-1d52-4e93-b8e3-6c37fd4c7dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:01:30.539088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670666f9-1d52-4e93-b8e3-6c37fd4c7dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:01:30.541142 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670666f9-1d52-4e93-b8e3-6c37fd4c7dd6 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:01:30.550443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 730/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:01:40.463746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=17 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:01:40.546350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=17 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:02:03.773886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78becd-eaaf-487c-9097-e41a2f2e3277 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:03.774456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78becd-eaaf-487c-9097-e41a2f2e3277 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:03.774456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78becd-eaaf-487c-9097-e41a2f2e3277 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:03.775766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 741/1471] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:02:03.781026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8259e-e4ab-41af-94e1-c309e029dc38 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:03.781486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8259e-e4ab-41af-94e1-c309e029dc38 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:03.781591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8259e-e4ab-41af-94e1-c309e029dc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:03.799424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-96e8259e-e4ab-41af-94e1-c309e029dc38 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:02:03.800610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-96e8259e-e4ab-41af-94e1-c309e029dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:02:03.808885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 731/1472] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:02:03.855009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c31af-d3b4-4646-a8f3-f62cd3983ae7 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:03.855300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c31af-d3b4-4646-a8f3-f62cd3983ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:03.855581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c31af-d3b4-4646-a8f3-f62cd3983ae7 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:03.856936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 742/1473] 10.222.0.30 () {54 vars in 962 bytes} [Mon May 23 18:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:02:03.861635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b81cd9-4f40-4514-aae1-529febad776e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:03.861929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b81cd9-4f40-4514-aae1-529febad776e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:03.862210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b81cd9-4f40-4514-aae1-529febad776e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:03.880421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-23b81cd9-4f40-4514-aae1-529febad776e None None] MFA Rules not processed for user `a2a5d7aee47e43e9904a93c6ce3bb412`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:02:03.881598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-23b81cd9-4f40-4514-aae1-529febad776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:02:03.888885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 732/1474] 10.222.0.30 () {58 vars in 1059 bytes} [Mon May 23 18:02:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:02:03.896068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c31af-d3b4-4646-a8f3-f62cd3983ae7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:02:03.906834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c31af-d3b4-4646-a8f3-f62cd3983ae7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:02:03.910152 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028115f9-871e-4758-aa02-34f97a27c7e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a5d7aee47e43e9904a93c6ce3bb412', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:02:03.910801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028115f9-871e-4758-aa02-34f97a27c7e7 service glance] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:03.911083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028115f9-871e-4758-aa02-34f97a27c7e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:03.911358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028115f9-871e-4758-aa02-34f97a27c7e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:03.920110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028115f9-871e-4758-aa02-34f97a27c7e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:02:03.921522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028115f9-871e-4758-aa02-34f97a27c7e7 service glance] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:02:03.931556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 743/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:02:06.249552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3370b16-9dce-4f24-a246-a85093597e05 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:06.250145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3370b16-9dce-4f24-a246-a85093597e05 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:06.250145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3370b16-9dce-4f24-a246-a85093597e05 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:06.251511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 733/1476] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:02:06.256721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b5f72-7e5b-4ca6-a5fd-234011d1ddae None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:06.257132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b5f72-7e5b-4ca6-a5fd-234011d1ddae None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:06.257405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b5f72-7e5b-4ca6-a5fd-234011d1ddae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:06.276506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-840b5f72-7e5b-4ca6-a5fd-234011d1ddae None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:02:06.277694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-840b5f72-7e5b-4ca6-a5fd-234011d1ddae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:02:06.285416 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 744/1477] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:02:06.308071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3370b16-9dce-4f24-a246-a85093597e05 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:02:06.320262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3370b16-9dce-4f24-a246-a85093597e05 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:02:06.325955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e3cf0-3db4-45d3-9456-ed8319ef62ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:02:06.326724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e3cf0-3db4-45d3-9456-ed8319ef62ca admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:06.327101 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e3cf0-3db4-45d3-9456-ed8319ef62ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:06.327406 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e3cf0-3db4-45d3-9456-ed8319ef62ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:06.328145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e3cf0-3db4-45d3-9456-ed8319ef62ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:02:06.329938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-ad4e3cf0-3db4-45d3-9456-ed8319ef62ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:02:06.329938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: warnings.warn(msg) May 23 18:02:06.329938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: May 23 18:02:06.331103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e3cf0-3db4-45d3-9456-ed8319ef62ca admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:02:06.350608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 734/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Mon May 23 18:02:06 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:02:08.577648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98da4f2-1c32-4fa4-9160-235f83400c1e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:08.578190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98da4f2-1c32-4fa4-9160-235f83400c1e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:08.578190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98da4f2-1c32-4fa4-9160-235f83400c1e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:08.579613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 745/1479] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:02:08.584754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9a2e1-f588-423f-a0fc-2e9b8c585215 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:08.585182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9a2e1-f588-423f-a0fc-2e9b8c585215 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:08.585342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9a2e1-f588-423f-a0fc-2e9b8c585215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:08.603901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3ce9a2e1-f588-423f-a0fc-2e9b8c585215 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:02:08.605094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3ce9a2e1-f588-423f-a0fc-2e9b8c585215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:02:08.612902 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 735/1480] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:02:08.667514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98da4f2-1c32-4fa4-9160-235f83400c1e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:02:08.682044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98da4f2-1c32-4fa4-9160-235f83400c1e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:02:08.687356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3118147-9ad9-4306-82dc-e7119117be12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:02:08.687985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118147-9ad9-4306-82dc-e7119117be12 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:08.688270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118147-9ad9-4306-82dc-e7119117be12 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:08.688549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118147-9ad9-4306-82dc-e7119117be12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:08.697126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3118147-9ad9-4306-82dc-e7119117be12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:02:08.698691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3118147-9ad9-4306-82dc-e7119117be12 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:02:08.707905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 746/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:02:11.112414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03e1ba-2bd2-4ec9-ac9f-ae54ef26f1c2 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:11.112974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03e1ba-2bd2-4ec9-ac9f-ae54ef26f1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:11.112974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03e1ba-2bd2-4ec9-ac9f-ae54ef26f1c2 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:11.114299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 736/1482] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:02:11.120603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fd788-7064-48e5-851b-f39ef7b8131a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:11.121045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fd788-7064-48e5-851b-f39ef7b8131a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:11.121153 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fd788-7064-48e5-851b-f39ef7b8131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:11.138923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-159fd788-7064-48e5-851b-f39ef7b8131a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:02:11.140111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-159fd788-7064-48e5-851b-f39ef7b8131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:02:11.147775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 747/1483] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:02:11.184640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03e1ba-2bd2-4ec9-ac9f-ae54ef26f1c2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:02:11.195252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03e1ba-2bd2-4ec9-ac9f-ae54ef26f1c2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:02:11.198918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8da17-9628-4c9e-be10-d1309e7dada2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:02:11.199554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8da17-9628-4c9e-be10-d1309e7dada2 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:11.199840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8da17-9628-4c9e-be10-d1309e7dada2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:11.200116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8da17-9628-4c9e-be10-d1309e7dada2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:11.208981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8da17-9628-4c9e-be10-d1309e7dada2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:02:11.210411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8da17-9628-4c9e-be10-d1309e7dada2 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:02:11.220252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 737/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:02:13.493094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1841b-0472-472f-a282-6fea19793a5a None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:13.493680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1841b-0472-472f-a282-6fea19793a5a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:13.493680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1841b-0472-472f-a282-6fea19793a5a None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:13.495040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 748/1485] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:02:13.500298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543480d-07c3-41ef-9318-0ac3f72d9358 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:13.500716 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543480d-07c3-41ef-9318-0ac3f72d9358 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:13.500859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543480d-07c3-41ef-9318-0ac3f72d9358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:13.519018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b543480d-07c3-41ef-9318-0ac3f72d9358 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:02:13.520212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b543480d-07c3-41ef-9318-0ac3f72d9358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:02:13.528517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 738/1486] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:02:13.566443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1841b-0472-472f-a282-6fea19793a5a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:02:13.577287 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1841b-0472-472f-a282-6fea19793a5a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:02:13.580780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dded59-2ba1-44fd-a464-880a726d69a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:02:13.581409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dded59-2ba1-44fd-a464-880a726d69a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:13.581689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dded59-2ba1-44fd-a464-880a726d69a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:13.581963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dded59-2ba1-44fd-a464-880a726d69a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:13.591817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dded59-2ba1-44fd-a464-880a726d69a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:02:13.593232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dded59-2ba1-44fd-a464-880a726d69a0 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:02:13.603103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 749/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:02:15.944063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305987-f73f-4514-bc1b-9617f2df563c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:15.944749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305987-f73f-4514-bc1b-9617f2df563c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:15.944749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305987-f73f-4514-bc1b-9617f2df563c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:15.946691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 739/1488] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:02:15.952153 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bacb04-d334-4390-9a2a-e8f830ebf51a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:15.952646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bacb04-d334-4390-9a2a-e8f830ebf51a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:15.953108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bacb04-d334-4390-9a2a-e8f830ebf51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:15.974388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-54bacb04-d334-4390-9a2a-e8f830ebf51a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:02:15.975665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-54bacb04-d334-4390-9a2a-e8f830ebf51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:02:15.984949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 750/1489] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:02:16.036825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7305987-f73f-4514-bc1b-9617f2df563c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:02:16.048147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7305987-f73f-4514-bc1b-9617f2df563c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:02:16.051621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207750-d187-40b3-a26d-e83c4158e3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:02:16.052253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207750-d187-40b3-a26d-e83c4158e3bf service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:16.052535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207750-d187-40b3-a26d-e83c4158e3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:16.052808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207750-d187-40b3-a26d-e83c4158e3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:16.062295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43207750-d187-40b3-a26d-e83c4158e3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:02:16.063759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43207750-d187-40b3-a26d-e83c4158e3bf service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:02:16.073060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 740/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:02:18.462042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1163c6-0170-47c6-b384-b9a3a16a0d7d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:18.462600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1163c6-0170-47c6-b384-b9a3a16a0d7d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:18.462600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1163c6-0170-47c6-b384-b9a3a16a0d7d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:18.464031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 751/1491] 10.222.0.30 () {54 vars in 926 bytes} [Mon May 23 18:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:02:18.469384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b372e6-f243-4d29-9517-309c02bb7adc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:18.469780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b372e6-f243-4d29-9517-309c02bb7adc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:18.469940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b372e6-f243-4d29-9517-309c02bb7adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:18.488057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-43b372e6-f243-4d29-9517-309c02bb7adc None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:02:18.489220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-43b372e6-f243-4d29-9517-309c02bb7adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:02:18.497886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 741/1492] 10.222.0.30 () {58 vars in 1023 bytes} [Mon May 23 18:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:02:18.536356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1163c6-0170-47c6-b384-b9a3a16a0d7d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:02:18.547695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1163c6-0170-47c6-b384-b9a3a16a0d7d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:02:18.551164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16b36f-32dd-4b9f-bc96-7638873e3156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:02:18.551794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b36f-32dd-4b9f-bc96-7638873e3156 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:02:18.552083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b36f-32dd-4b9f-bc96-7638873e3156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:02:18.552359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b36f-32dd-4b9f-bc96-7638873e3156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:02:18.561825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16b36f-32dd-4b9f-bc96-7638873e3156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:02:18.563376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16b36f-32dd-4b9f-bc96-7638873e3156 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:02:18.572914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 752/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:02:28.483025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=33 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:02:28.568460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=33 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:03:59.560713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9fe87-07f1-4162-8178-08f1c4ac45b2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:03:59.561240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9fe87-07f1-4162-8178-08f1c4ac45b2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:03:59.561349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9fe87-07f1-4162-8178-08f1c4ac45b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:03:59.578991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a0c9fe87-07f1-4162-8178-08f1c4ac45b2 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:03:59.580172 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a0c9fe87-07f1-4162-8178-08f1c4ac45b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:03:59.588171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 742/1494] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:03:59.597147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c9e57-088c-4635-a701-703dba0b7f21 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:03:59.597619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c9e57-088c-4635-a701-703dba0b7f21 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:03:59.597722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c9e57-088c-4635-a701-703dba0b7f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:03:59.616173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ca9c9e57-088c-4635-a701-703dba0b7f21 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:03:59.617364 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ca9c9e57-088c-4635-a701-703dba0b7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:03:59.624950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 753/1495] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:03:59.629554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9fe87-07f1-4162-8178-08f1c4ac45b2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:03:59.639937 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9fe87-07f1-4162-8178-08f1c4ac45b2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:03:59.644438 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c562f-4955-4b14-9946-187a7a51e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:03:59.645088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c562f-4955-4b14-9946-187a7a51e44f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:03:59.645416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c562f-4955-4b14-9946-187a7a51e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:03:59.645931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c562f-4955-4b14-9946-187a7a51e44f admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:03:59.646674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c562f-4955-4b14-9946-187a7a51e44f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:03:59.647016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c562f-4955-4b14-9946-187a7a51e44f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:03:59.648037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-992c562f-4955-4b14-9946-187a7a51e44f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:03:59.648037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: warnings.warn(msg) May 23 18:03:59.648037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: May 23 18:03:59.648917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c562f-4955-4b14-9946-187a7a51e44f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:03:59.660204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 743/1496] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:03:59.668877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c9e57-088c-4635-a701-703dba0b7f21 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:03:59.678564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c9e57-088c-4635-a701-703dba0b7f21 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:03:59.683143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f0db9-0e65-44f9-abde-3fb25d685e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:03:59.683784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f0db9-0e65-44f9-abde-3fb25d685e6e admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:03:59.684068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f0db9-0e65-44f9-abde-3fb25d685e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:03:59.684346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f0db9-0e65-44f9-abde-3fb25d685e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:03:59.685044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f0db9-0e65-44f9-abde-3fb25d685e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:03:59.686866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-2d7f0db9-0e65-44f9-abde-3fb25d685e6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:03:59.686866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: warnings.warn(msg) May 23 18:03:59.686866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: May 23 18:03:59.688051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f0db9-0e65-44f9-abde-3fb25d685e6e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:03:59.723880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 754/1497] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:03:59 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:03:59.728079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c562f-4955-4b14-9946-187a7a51e44f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:03:59.737902 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c562f-4955-4b14-9946-187a7a51e44f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:03:59.793672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f35f-e88a-4855-9038-ae30e7329add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:03:59.794261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f35f-e88a-4855-9038-ae30e7329add admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:03:59.794539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f35f-e88a-4855-9038-ae30e7329add admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:03:59.794847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f35f-e88a-4855-9038-ae30e7329add admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:03:59.795553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811f35f-e88a-4855-9038-ae30e7329add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:03:59.796543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-c811f35f-e88a-4855-9038-ae30e7329add admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:03:59.796543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: warnings.warn(msg) May 23 18:03:59.796543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: May 23 18:03:59.797741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811f35f-e88a-4855-9038-ae30e7329add admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:03:59.817041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 744/1498] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:03:59 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:03:59.821840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f0db9-0e65-44f9-abde-3fb25d685e6e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:03:59.831857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f0db9-0e65-44f9-abde-3fb25d685e6e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:03:59.837396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf762a7-6558-40b8-b890-dc9bd7e74eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:03:59.838048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf762a7-6558-40b8-b890-dc9bd7e74eda admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:03:59.838330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf762a7-6558-40b8-b890-dc9bd7e74eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:03:59.838603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf762a7-6558-40b8-b890-dc9bd7e74eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:03:59.839354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf762a7-6558-40b8-b890-dc9bd7e74eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:03:59.840359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-ecf762a7-6558-40b8-b890-dc9bd7e74eda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:03:59.840359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: warnings.warn(msg) May 23 18:03:59.840359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: May 23 18:03:59.841224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf762a7-6558-40b8-b890-dc9bd7e74eda admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:03:59.854418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 755/1499] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:03:59.858408 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f35f-e88a-4855-9038-ae30e7329add admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:03:59.868726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f35f-e88a-4855-9038-ae30e7329add admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:03:59.873347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083fd10-1139-4ed1-9e5e-266c37516f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:03:59.873997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083fd10-1139-4ed1-9e5e-266c37516f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:03:59.874280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083fd10-1139-4ed1-9e5e-266c37516f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:03:59.874552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083fd10-1139-4ed1-9e5e-266c37516f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:03:59.875303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083fd10-1139-4ed1-9e5e-266c37516f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:03:59.876313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-0083fd10-1139-4ed1-9e5e-266c37516f44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:03:59.876313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: warnings.warn(msg) May 23 18:03:59.876313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: May 23 18:03:59.877187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083fd10-1139-4ed1-9e5e-266c37516f44 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:03:59.892319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 745/1500] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:03:59.896409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf762a7-6558-40b8-b890-dc9bd7e74eda admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:03:59.906146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf762a7-6558-40b8-b890-dc9bd7e74eda admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:03:59.911767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b10af-f8a7-48a0-a6d8-f54c15d61fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:03:59.912634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b10af-f8a7-48a0-a6d8-f54c15d61fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:03:59.913034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b10af-f8a7-48a0-a6d8-f54c15d61fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:03:59.913321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b10af-f8a7-48a0-a6d8-f54c15d61fa0 admin admin] PATH_INFO: `/v3/projects/c1a20b920a214f19abc7f823602e2d76/users/573922a7169840dbb1a18a9510c7cd85/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:03:59.929206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b10af-f8a7-48a0-a6d8-f54c15d61fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a20b920a214f19abc7f823602e2d76, user_id=573922a7169840dbb1a18a9510c7cd85, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:03:59.930300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-450b10af-f8a7-48a0-a6d8-f54c15d61fa0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:03:59.930300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: warnings.warn(msg) May 23 18:03:59.930300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: May 23 18:03:59.932278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b10af-f8a7-48a0-a6d8-f54c15d61fa0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:03:59.945249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 756/1501] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:03:59 2022] PUT /identity/v3/projects/c1a20b920a214f19abc7f823602e2d76/users/573922a7169840dbb1a18a9510c7cd85/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:03:59.956497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3059230-d172-4540-a2ef-834b566a317b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:03:59.956833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3059230-d172-4540-a2ef-834b566a317b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:03:59.957131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3059230-d172-4540-a2ef-834b566a317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:03:59.984844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f3059230-d172-4540-a2ef-834b566a317b None None] MFA Rules not processed for user `573922a7169840dbb1a18a9510c7cd85`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:03:59.986797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f3059230-d172-4540-a2ef-834b566a317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:04:00.053123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 746/1502] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:03:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:04:00.066245 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f7dee-263a-4bff-b602-3d9480cbddb4 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:04:00.066538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f7dee-263a-4bff-b602-3d9480cbddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:04:00.066925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f7dee-263a-4bff-b602-3d9480cbddb4 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:04:00.069036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 757/1503] 10.222.0.30 () {54 vars in 963 bytes} [Mon May 23 18:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:04:00.073832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2891621-1b14-4bf7-b062-8d3f3e25c395 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:04:00.074120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2891621-1b14-4bf7-b062-8d3f3e25c395 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:04:00.074394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2891621-1b14-4bf7-b062-8d3f3e25c395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:04:00.091949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e2891621-1b14-4bf7-b062-8d3f3e25c395 None None] MFA Rules not processed for user `e8eae73572d54dcaac9f3f6bb24df316`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:04:00.093118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e2891621-1b14-4bf7-b062-8d3f3e25c395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:04:00.136228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:04:00.144545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 747/1504] 10.222.0.30 () {58 vars in 1060 bytes} [Mon May 23 18:04:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:04:00.152215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f7dee-263a-4bff-b602-3d9480cbddb4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:04:00.162968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f7dee-263a-4bff-b602-3d9480cbddb4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:04:00.166373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e576c8a-15db-4bca-8380-98c4043d7bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:04:00.167035 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e576c8a-15db-4bca-8380-98c4043d7bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:04:00.167319 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e576c8a-15db-4bca-8380-98c4043d7bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:04:00.167587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e576c8a-15db-4bca-8380-98c4043d7bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:04:00.175702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e576c8a-15db-4bca-8380-98c4043d7bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:04:00.177710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e576c8a-15db-4bca-8380-98c4043d7bc0 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:04:00.186440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 758/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:04:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:04:00.228542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e168fc-f68b-48da-9f98-fd6692f01775 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:04:00.228829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e168fc-f68b-48da-9f98-fd6692f01775 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:04:00.229104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e168fc-f68b-48da-9f98-fd6692f01775 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:04:00.230375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 748/1506] 10.222.0.30 () {52 vars in 829 bytes} [Mon May 23 18:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:04:00.233915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e576c8a-15db-4bca-8380-98c4043d7bc0 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:04:00.299785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e576c8a-15db-4bca-8380-98c4043d7bc0 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:04:00.304900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:04:00.305744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:04:00.306024 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:04:00.306297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] PATH_INFO: `/v3/users/573922a7169840dbb1a18a9510c7cd85` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:04:00.307505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=573922a7169840dbb1a18a9510c7cd85)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:04:00.308512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:04:00.308512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: warnings.warn(msg) May 23 18:04:00.308512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: May 23 18:04:00.309704 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:04:00.377832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573922a7169840dbb1a18a9510c7cd85'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:04:00.390584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573922a7169840dbb1a18a9510c7cd85'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:04:00.391274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573922a7169840dbb1a18a9510c7cd85'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:04:00.392037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573922a7169840dbb1a18a9510c7cd85'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:04:00.409965 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573922a7169840dbb1a18a9510c7cd85'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:04:00.414630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:04:00.425974 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 759/1507] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:04:00 2022] DELETE /identity/v3/users/573922a7169840dbb1a18a9510c7cd85 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:04:00.431117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42daea9-4bbd-41bc-b735-7a00bd218c72 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:04:00.431428 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42daea9-4bbd-41bc-b735-7a00bd218c72 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:04:00.431704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42daea9-4bbd-41bc-b735-7a00bd218c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:04:00.448859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f42daea9-4bbd-41bc-b735-7a00bd218c72 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:04:00.450032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f42daea9-4bbd-41bc-b735-7a00bd218c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:04:00.507410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 749/1508] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:04:00.517199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:04:00.518688 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:04:00.576258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbe844-d595-4162-947d-300a5f9df084 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:04:00.580001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac9fad-885a-4af9-89c8-fe128e955c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:04:00.580656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac9fad-885a-4af9-89c8-fe128e955c17 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:04:00.580940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac9fad-885a-4af9-89c8-fe128e955c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:04:00.581215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac9fad-885a-4af9-89c8-fe128e955c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:04:00.590313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac9fad-885a-4af9-89c8-fe128e955c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:04:00.591778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac9fad-885a-4af9-89c8-fe128e955c17 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:04:00.601512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 760/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:04:00.951901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42daea9-4bbd-41bc-b735-7a00bd218c72 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:04:00.953480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f42daea9-4bbd-41bc-b735-7a00bd218c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:04:00.966092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42daea9-4bbd-41bc-b735-7a00bd218c72 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:04:00.970669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:04:00.971543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:04:00.971832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:04:00.972107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] PATH_INFO: `/v3/projects/c1a20b920a214f19abc7f823602e2d76` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:04:00.979486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a20b920a214f19abc7f823602e2d76)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:04:00.980535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:04:00.980535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: warnings.warn(msg) May 23 18:04:00.980535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: May 23 18:04:00.981768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:04:01.043943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a20b920a214f19abc7f823602e2d76', 'request_id': 'req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:04:01.054840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a20b920a214f19abc7f823602e2d76', 'request_id': 'req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:04:01.060898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a20b920a214f19abc7f823602e2d76', 'request_id': 'req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:04:01.079527 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] The token cache is being invalidate because project c1a20b920a214f19abc7f823602e2d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:04:01.079759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:04:01.080402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bbc65c6b-144c-4bdc-8fe7-edbc7eb8e518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:04:01.082028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 750/1510] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:04:00 2022] DELETE /identity/v3/projects/c1a20b920a214f19abc7f823602e2d76 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:04:10.596921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:04:11.076301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:05:41.012559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13f03-b681-4b86-80e5-68739ca88485 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:41.013148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13f03-b681-4b86-80e5-68739ca88485 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:41.013261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13f03-b681-4b86-80e5-68739ca88485 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:41.014674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:05:41.019626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508d317-87fd-4962-9921-4b95a4131f33 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:41.020087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508d317-87fd-4962-9921-4b95a4131f33 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:41.020185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508d317-87fd-4962-9921-4b95a4131f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:41.038253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f508d317-87fd-4962-9921-4b95a4131f33 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:05:41.039492 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f508d317-87fd-4962-9921-4b95a4131f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:05:41.102118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:05:41.271057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13f03-b681-4b86-80e5-68739ca88485 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:05:41.272850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4cc13f03-b681-4b86-80e5-68739ca88485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:05:41.346548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13f03-b681-4b86-80e5-68739ca88485 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:05:41.352584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2ff9e-0de4-42e8-8705-54a0990207e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:05:41.353175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ff9e-0de4-42e8-8705-54a0990207e3 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:41.353459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ff9e-0de4-42e8-8705-54a0990207e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:41.353738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ff9e-0de4-42e8-8705-54a0990207e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:41.361714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2ff9e-0de4-42e8-8705-54a0990207e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:05:41.363451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2ff9e-0de4-42e8-8705-54a0990207e3 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:05:41.372603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 762/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:05:42.270765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b4a3e-4650-4a7d-9740-1138d787507a None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:42.271295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b4a3e-4650-4a7d-9740-1138d787507a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:42.271295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b4a3e-4650-4a7d-9740-1138d787507a None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:42.272634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:05:42.277390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a5ad5-5e68-4c8d-b37b-94916cef7557 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:42.277830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a5ad5-5e68-4c8d-b37b-94916cef7557 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:42.277929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a5ad5-5e68-4c8d-b37b-94916cef7557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:42.296459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-693a5ad5-5e68-4c8d-b37b-94916cef7557 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:05:42.297658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-693a5ad5-5e68-4c8d-b37b-94916cef7557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:05:42.310144 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:05:42.464683 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b4a3e-4650-4a7d-9740-1138d787507a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:05:42.479390 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b4a3e-4650-4a7d-9740-1138d787507a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:05:42.484755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453cc76-fd24-4587-83b5-9a4bebe5ce09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:05:42.485388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453cc76-fd24-4587-83b5-9a4bebe5ce09 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:42.485673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453cc76-fd24-4587-83b5-9a4bebe5ce09 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:42.485951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453cc76-fd24-4587-83b5-9a4bebe5ce09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:42.494751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453cc76-fd24-4587-83b5-9a4bebe5ce09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:05:42.496386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453cc76-fd24-4587-83b5-9a4bebe5ce09 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:05:42.506208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 753/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:05:42.870479 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4493d-8365-4f9d-af18-db93ab0c2093 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:42.870994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4493d-8365-4f9d-af18-db93ab0c2093 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:42.871515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4493d-8365-4f9d-af18-db93ab0c2093 None None] PATH_INFO: `/v3` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:42.873422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 764/1517] 10.222.0.41 () {54 vars in 925 bytes} [Mon May 23 18:05:42 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:05:42.879696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a807c3f-b04d-4e8c-83e9-e2537d0ffd72 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:42.880001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a807c3f-b04d-4e8c-83e9-e2537d0ffd72 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:42.880268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a807c3f-b04d-4e8c-83e9-e2537d0ffd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:42.903094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6a807c3f-b04d-4e8c-83e9-e2537d0ffd72 None None] MFA Rules not processed for user `77e042a473204d358e3b0682bf1338d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:05:42.904336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6a807c3f-b04d-4e8c-83e9-e2537d0ffd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:05:42.979711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 754/1518] 10.222.0.41 () {58 vars in 1015 bytes} [Mon May 23 18:05:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:05:46.845372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6b6b-53b7-4f54-91e8-e65b6c1eadc9 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:46.845932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6b6b-53b7-4f54-91e8-e65b6c1eadc9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:46.845932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6b6b-53b7-4f54-91e8-e65b6c1eadc9 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:46.847815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 765/1519] 10.222.0.30 () {54 vars in 960 bytes} [Mon May 23 18:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:05:46.853072 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ce9bc-ac52-4ea2-bcef-3bde9e3c9daa None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:46.853461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ce9bc-ac52-4ea2-bcef-3bde9e3c9daa None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:46.853630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ce9bc-ac52-4ea2-bcef-3bde9e3c9daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:46.872151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-608ce9bc-ac52-4ea2-bcef-3bde9e3c9daa None None] MFA Rules not processed for user `77e042a473204d358e3b0682bf1338d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:05:46.873365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-608ce9bc-ac52-4ea2-bcef-3bde9e3c9daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:05:46.881613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 755/1520] 10.222.0.30 () {58 vars in 1057 bytes} [Mon May 23 18:05:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:05:46.889488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad6b6b-53b7-4f54-91e8-e65b6c1eadc9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:05:46.902654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad6b6b-53b7-4f54-91e8-e65b6c1eadc9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:05:46.907517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f8641-2356-41d5-aad3-963b22e873b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:05:46.908141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f8641-2356-41d5-aad3-963b22e873b2 service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:46.908424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f8641-2356-41d5-aad3-963b22e873b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:46.908702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f8641-2356-41d5-aad3-963b22e873b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:46.917456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f8641-2356-41d5-aad3-963b22e873b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:05:46.919107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f8641-2356-41d5-aad3-963b22e873b2 service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:05:46.929322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 766/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:05:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:05:53.834320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04b68-475c-45af-b30d-efd4d34ad223 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:53.834929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04b68-475c-45af-b30d-efd4d34ad223 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:53.834929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04b68-475c-45af-b30d-efd4d34ad223 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:53.836225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:05:53.841134 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c6d7b-364a-4d2a-8ce2-5977d8659abe None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:53.841569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c6d7b-364a-4d2a-8ce2-5977d8659abe None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:53.841684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c6d7b-364a-4d2a-8ce2-5977d8659abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:53.859515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-380c6d7b-364a-4d2a-8ce2-5977d8659abe None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:05:53.860733 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-380c6d7b-364a-4d2a-8ce2-5977d8659abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:05:53.868851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:05:54.023295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b04b68-475c-45af-b30d-efd4d34ad223 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:05:54.037441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b04b68-475c-45af-b30d-efd4d34ad223 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:05:54.042595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2435c-de28-4839-b1be-f5e4c91fb6d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:05:54.043258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2435c-de28-4839-b1be-f5e4c91fb6d7 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:54.043539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2435c-de28-4839-b1be-f5e4c91fb6d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:54.043812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2435c-de28-4839-b1be-f5e4c91fb6d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:54.052641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2435c-de28-4839-b1be-f5e4c91fb6d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:05:54.054247 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2435c-de28-4839-b1be-f5e4c91fb6d7 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:05:54.063537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 757/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:05:54.962973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628da9b-0de5-4844-a756-58ea449c6eea None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:54.963522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628da9b-0de5-4844-a756-58ea449c6eea None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:54.963522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628da9b-0de5-4844-a756-58ea449c6eea None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:54.964921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 18:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:05:54.969698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e0d39-ac63-43e2-886a-27e4aff7ec98 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:54.970230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e0d39-ac63-43e2-886a-27e4aff7ec98 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:54.970355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e0d39-ac63-43e2-886a-27e4aff7ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:54.988520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b00e0d39-ac63-43e2-886a-27e4aff7ec98 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:05:54.989724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b00e0d39-ac63-43e2-886a-27e4aff7ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:05:54.997445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 18:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:05:55.152861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628da9b-0de5-4844-a756-58ea449c6eea None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:05:55.167478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628da9b-0de5-4844-a756-58ea449c6eea None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:05:55.172792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7327ef-99f1-4c55-9423-d609d65b603d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:05:55.173422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7327ef-99f1-4c55-9423-d609d65b603d service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:55.173705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7327ef-99f1-4c55-9423-d609d65b603d service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:55.173985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7327ef-99f1-4c55-9423-d609d65b603d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:55.182289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7327ef-99f1-4c55-9423-d609d65b603d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:05:55.183943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7327ef-99f1-4c55-9423-d609d65b603d service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:05:55.193747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 769/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:05:59.160804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898516-ef9c-44ee-9b9d-d1fef6418641 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:59.161370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898516-ef9c-44ee-9b9d-d1fef6418641 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:59.161370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898516-ef9c-44ee-9b9d-d1fef6418641 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:59.162907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:05:59.168090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2c5ca-13e1-4f2e-a40c-eddf0afd1a82 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:59.168491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2c5ca-13e1-4f2e-a40c-eddf0afd1a82 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:59.168689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2c5ca-13e1-4f2e-a40c-eddf0afd1a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:59.186956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-33b2c5ca-13e1-4f2e-a40c-eddf0afd1a82 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:05:59.188167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-33b2c5ca-13e1-4f2e-a40c-eddf0afd1a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:05:59.196430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:05:59.231356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898516-ef9c-44ee-9b9d-d1fef6418641 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:05:59.233032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a8898516-ef9c-44ee-9b9d-d1fef6418641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:05:59.290015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898516-ef9c-44ee-9b9d-d1fef6418641 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:05:59.293526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a739e6-8198-4027-adc2-6217a4ff415a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:05:59.294167 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a739e6-8198-4027-adc2-6217a4ff415a service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:05:59.294450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a739e6-8198-4027-adc2-6217a4ff415a service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:05:59.294757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a739e6-8198-4027-adc2-6217a4ff415a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:05:59.303980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a739e6-8198-4027-adc2-6217a4ff415a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:05:59.305401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a739e6-8198-4027-adc2-6217a4ff415a service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:05:59.310230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:05:59.315326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 760/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:06:01.501021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d348-7508-441e-a7f1-fccd7e9e363e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:06:01.501606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d348-7508-441e-a7f1-fccd7e9e363e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:06:01.501606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d348-7508-441e-a7f1-fccd7e9e363e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:06:01.503020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:06:01.509246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d75f0-1529-4b2e-8e8c-efa378ba6b24 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:06:01.509661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d75f0-1529-4b2e-8e8c-efa378ba6b24 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:06:01.509785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d75f0-1529-4b2e-8e8c-efa378ba6b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:06:01.527579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7a8d75f0-1529-4b2e-8e8c-efa378ba6b24 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:06:01.528761 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7a8d75f0-1529-4b2e-8e8c-efa378ba6b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:06:01.536369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:06:01.571665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514d348-7508-441e-a7f1-fccd7e9e363e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:06:01.582386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514d348-7508-441e-a7f1-fccd7e9e363e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:06:01.585860 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b8fd5-9660-42b1-b6ea-e1d11d97c16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:06:01.586489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b8fd5-9660-42b1-b6ea-e1d11d97c16d service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:06:01.586811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b8fd5-9660-42b1-b6ea-e1d11d97c16d service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:06:01.587088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b8fd5-9660-42b1-b6ea-e1d11d97c16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:06:01.595862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b8fd5-9660-42b1-b6ea-e1d11d97c16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:06:01.597344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b8fd5-9660-42b1-b6ea-e1d11d97c16d service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:06:01.607154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 772/1533] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:06:05.423850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f650e-b40e-4dcf-9f49-e985e2d35526 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:06:05.424441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f650e-b40e-4dcf-9f49-e985e2d35526 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:06:05.424441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f650e-b40e-4dcf-9f49-e985e2d35526 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:06:05.425805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:06:05.431070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b735e9d-72b0-4c27-bb77-69f45d8515e2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:06:05.431504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b735e9d-72b0-4c27-bb77-69f45d8515e2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:06:05.431608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b735e9d-72b0-4c27-bb77-69f45d8515e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:06:05.451886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4b735e9d-72b0-4c27-bb77-69f45d8515e2 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:06:05.453114 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4b735e9d-72b0-4c27-bb77-69f45d8515e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:06:05.461680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:06:05.736365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f650e-b40e-4dcf-9f49-e985e2d35526 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:06:05.738106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2b7f650e-b40e-4dcf-9f49-e985e2d35526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:06:05.796230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f650e-b40e-4dcf-9f49-e985e2d35526 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:06:05.799712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344baaf-9c06-45ef-aefe-debcfef7c2fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:06:05.801137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344baaf-9c06-45ef-aefe-debcfef7c2fe service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:06:05.801422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344baaf-9c06-45ef-aefe-debcfef7c2fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:06:05.801694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344baaf-9c06-45ef-aefe-debcfef7c2fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:06:05.810634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344baaf-9c06-45ef-aefe-debcfef7c2fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:06:05.812084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344baaf-9c06-45ef-aefe-debcfef7c2fe service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:06:05.822041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 763/1536] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:06:08.075542 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54293bf-f80d-4d4c-a8a4-9e0b7071e5a6 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:06:08.076123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54293bf-f80d-4d4c-a8a4-9e0b7071e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:06:08.076123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54293bf-f80d-4d4c-a8a4-9e0b7071e5a6 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:06:08.077443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 18:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:06:08.082918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75c16-49a6-41bf-b1f0-7bfa31cb0c2d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:06:08.083416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75c16-49a6-41bf-b1f0-7bfa31cb0c2d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:06:08.083619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75c16-49a6-41bf-b1f0-7bfa31cb0c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:06:08.105561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-78f75c16-49a6-41bf-b1f0-7bfa31cb0c2d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:06:08.106797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-78f75c16-49a6-41bf-b1f0-7bfa31cb0c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:06:08.115196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 18:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:06:08.387650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54293bf-f80d-4d4c-a8a4-9e0b7071e5a6 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:06:08.389306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e54293bf-f80d-4d4c-a8a4-9e0b7071e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:06:08.402424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54293bf-f80d-4d4c-a8a4-9e0b7071e5a6 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:06:08.405987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705dd41-60a8-4593-8549-732f2c4a8ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:06:08.406621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705dd41-60a8-4593-8549-732f2c4a8ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:06:08.406938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705dd41-60a8-4593-8549-732f2c4a8ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:06:08.407214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705dd41-60a8-4593-8549-732f2c4a8ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:06:08.416558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705dd41-60a8-4593-8549-732f2c4a8ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:06:08.417971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705dd41-60a8-4593-8549-732f2c4a8ce7 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:06:08.427825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 775/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:06:18.100237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=32 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:06:18.423138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=70 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:37.501797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2318a5d-dd1a-4869-bf99-4e63ed349b6e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.502957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2318a5d-dd1a-4869-bf99-4e63ed349b6e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.503473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2318a5d-dd1a-4869-bf99-4e63ed349b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.535490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f2318a5d-dd1a-4869-bf99-4e63ed349b6e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:37.537058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f2318a5d-dd1a-4869-bf99-4e63ed349b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:37.549564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 765/1540] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:07:37.560536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001c7e-ea25-485a-847e-ef7dbf8fadd1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.561112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001c7e-ea25-485a-847e-ef7dbf8fadd1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.561112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001c7e-ea25-485a-847e-ef7dbf8fadd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.570613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c9f63-2bf6-47ba-8102-3e6fef168a4d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.571290 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c9f63-2bf6-47ba-8102-3e6fef168a4d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.571851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c9f63-2bf6-47ba-8102-3e6fef168a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.593210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4e001c7e-ea25-485a-847e-ef7dbf8fadd1 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:37.594469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4e001c7e-ea25-485a-847e-ef7dbf8fadd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:37.603533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-df7c9f63-2bf6-47ba-8102-3e6fef168a4d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:37.605321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-df7c9f63-2bf6-47ba-8102-3e6fef168a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:37.622393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 766/1541] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 23 18:07:37.623221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 776/1542] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:37.628983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c9f63-2bf6-47ba-8102-3e6fef168a4d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:37.634544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333e270-2f01-42ba-b8bb-2e9d32a69240 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.636745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333e270-2f01-42ba-b8bb-2e9d32a69240 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.636745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333e270-2f01-42ba-b8bb-2e9d32a69240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.649588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c9f63-2bf6-47ba-8102-3e6fef168a4d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:37.660292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d72adb-9b3b-48b4-b932-f43256c41bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:37.661701 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d72adb-9b3b-48b4-b932-f43256c41bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.662231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d72adb-9b3b-48b4-b932-f43256c41bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.662790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d72adb-9b3b-48b4-b932-f43256c41bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.663797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d72adb-9b3b-48b4-b932-f43256c41bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:07:37.664379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d72adb-9b3b-48b4-b932-f43256c41bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:37.666485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d72adb-9b3b-48b4-b932-f43256c41bc3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:37.679934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e333e270-2f01-42ba-b8bb-2e9d32a69240 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:37.681163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e333e270-2f01-42ba-b8bb-2e9d32a69240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:37.694602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 767/1543] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:07:37.700195 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae0e4b-a7ee-484c-ae27-d863c593350c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.700841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae0e4b-a7ee-484c-ae27-d863c593350c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.703540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae0e4b-a7ee-484c-ae27-d863c593350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.705072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 777/1544] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:07:37.710837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333e270-2f01-42ba-b8bb-2e9d32a69240 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:37.730305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333e270-2f01-42ba-b8bb-2e9d32a69240 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:37.740152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-37ae0e4b-a7ee-484c-ae27-d863c593350c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:37.741979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-37ae0e4b-a7ee-484c-ae27-d863c593350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:37.742742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2b75b-0fd4-45ec-86ec-3bc51cd33fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:37.743502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b75b-0fd4-45ec-86ec-3bc51cd33fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.743841 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b75b-0fd4-45ec-86ec-3bc51cd33fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.744322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b75b-0fd4-45ec-86ec-3bc51cd33fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.745241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2b75b-0fd4-45ec-86ec-3bc51cd33fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:07:37.745718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2b75b-0fd4-45ec-86ec-3bc51cd33fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:37.746948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-c2e2b75b-0fd4-45ec-86ec-3bc51cd33fc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 18:07:37.746948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: warnings.warn(msg) May 23 18:07:37.746948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: May 23 18:07:37.748419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2b75b-0fd4-45ec-86ec-3bc51cd33fc6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:37.763917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 768/1545] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:07:37.765113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae0e4b-a7ee-484c-ae27-d863c593350c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:37.771566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 778/1546] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:07:37.773405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbad39-3337-4b73-89d3-837ec5053cf4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.773924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbad39-3337-4b73-89d3-837ec5053cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.774390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbad39-3337-4b73-89d3-837ec5053cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.784305 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae0e4b-a7ee-484c-ae27-d863c593350c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:37.800418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392812a-8592-49ed-b861-30a595aae940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:37.801205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392812a-8592-49ed-b861-30a595aae940 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.801564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392812a-8592-49ed-b861-30a595aae940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.802063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392812a-8592-49ed-b861-30a595aae940 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.802856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392812a-8592-49ed-b861-30a595aae940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:37.804352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-5392812a-8592-49ed-b861-30a595aae940 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:07:37.804352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: warnings.warn(msg) May 23 18:07:37.804352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: May 23 18:07:37.806026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392812a-8592-49ed-b861-30a595aae940 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:37.828815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7bcbad39-3337-4b73-89d3-837ec5053cf4 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:37.830444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7bcbad39-3337-4b73-89d3-837ec5053cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:37.847239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 779/1547] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:37.849962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653438c4-b43c-4a5a-a89b-7066d326bf96 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.850590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653438c4-b43c-4a5a-a89b-7066d326bf96 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.851131 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653438c4-b43c-4a5a-a89b-7066d326bf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.872934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 769/1548] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:37.873586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392812a-8592-49ed-b861-30a595aae940 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:37.886584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-653438c4-b43c-4a5a-a89b-7066d326bf96 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:37.887812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-653438c4-b43c-4a5a-a89b-7066d326bf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:37.964195 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392812a-8592-49ed-b861-30a595aae940 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:37.968712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e235443-668c-480c-9bd7-b552819e0dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:37.969405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e235443-668c-480c-9bd7-b552819e0dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.969697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e235443-668c-480c-9bd7-b552819e0dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.969947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 780/1549] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:37.970099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e235443-668c-480c-9bd7-b552819e0dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.970978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e235443-668c-480c-9bd7-b552819e0dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:37.971471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452c70d-85f3-467e-a56a-536d7fc3dc6e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:37.971668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452c70d-85f3-467e-a56a-536d7fc3dc6e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:37.972001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452c70d-85f3-467e-a56a-536d7fc3dc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:37.972949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e235443-668c-480c-9bd7-b552819e0dd4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:37.989959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1452c70d-85f3-467e-a56a-536d7fc3dc6e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:37.991265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1452c70d-85f3-467e-a56a-536d7fc3dc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:38.000075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 781/1550] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:38.001290 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b113aa-6094-4600-8e66-bf9d449fc063 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.001584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b113aa-6094-4600-8e66-bf9d449fc063 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.001864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b113aa-6094-4600-8e66-bf9d449fc063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.013443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 770/1551] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.013443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e235443-668c-480c-9bd7-b552819e0dd4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.023033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c9b113aa-6094-4600-8e66-bf9d449fc063 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:38.024157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c9b113aa-6094-4600-8e66-bf9d449fc063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:38.075867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e235443-668c-480c-9bd7-b552819e0dd4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.082170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd34cc0-3774-4ca8-b113-8e577c8fafc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.083013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd34cc0-3774-4ca8-b113-8e577c8fafc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.083302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd34cc0-3774-4ca8-b113-8e577c8fafc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.083585 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd34cc0-3774-4ca8-b113-8e577c8fafc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.084296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd34cc0-3774-4ca8-b113-8e577c8fafc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.086208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 782/1552] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:38.086357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd34cc0-3774-4ca8-b113-8e577c8fafc6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.087835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557151a-b7be-40a6-bae6-9b35b76cd6e9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.088122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557151a-b7be-40a6-bae6-9b35b76cd6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.088403 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557151a-b7be-40a6-bae6-9b35b76cd6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.109239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1557151a-b7be-40a6-bae6-9b35b76cd6e9 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:38.110471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1557151a-b7be-40a6-bae6-9b35b76cd6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:38.114288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 771/1553] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.114288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48908b20-bb87-47aa-8191-34b44e751a0d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.114288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48908b20-bb87-47aa-8191-34b44e751a0d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.114288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48908b20-bb87-47aa-8191-34b44e751a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.119394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 783/1554] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:38.124207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce70b9-1142-4ae6-b9dd-c82f2d408c58 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.124508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce70b9-1142-4ae6-b9dd-c82f2d408c58 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.124779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce70b9-1142-4ae6-b9dd-c82f2d408c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.132295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-48908b20-bb87-47aa-8191-34b44e751a0d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:38.133778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-48908b20-bb87-47aa-8191-34b44e751a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:38.141733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 772/1555] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:38.142499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48908b20-bb87-47aa-8191-34b44e751a0d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.147744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-93ce70b9-1142-4ae6-b9dd-c82f2d408c58 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:38.149154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-93ce70b9-1142-4ae6-b9dd-c82f2d408c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:38.155785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48908b20-bb87-47aa-8191-34b44e751a0d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.157681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 784/1556] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:38.159862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a851a-f40f-4783-ac97-20a5901bc0b4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.160159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a851a-f40f-4783-ac97-20a5901bc0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.160441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a851a-f40f-4783-ac97-20a5901bc0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.161416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00440be8-c289-44f1-87c3-4b612df19af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.162074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00440be8-c289-44f1-87c3-4b612df19af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.162357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00440be8-c289-44f1-87c3-4b612df19af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.162633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00440be8-c289-44f1-87c3-4b612df19af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.163404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00440be8-c289-44f1-87c3-4b612df19af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:07:38.163734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00440be8-c289-44f1-87c3-4b612df19af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.165315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00440be8-c289-44f1-87c3-4b612df19af2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.174235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:38.177996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 773/1557] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:07:38.179118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00440be8-c289-44f1-87c3-4b612df19af2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.183887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-702a851a-f40f-4783-ac97-20a5901bc0b4 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:38.185495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-702a851a-f40f-4783-ac97-20a5901bc0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:38.189979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00440be8-c289-44f1-87c3-4b612df19af2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.193606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 785/1558] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:38.194373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a851a-f40f-4783-ac97-20a5901bc0b4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.197859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c197a0d-5937-40fa-85b2-6ad7216c73cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.198515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c197a0d-5937-40fa-85b2-6ad7216c73cd admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.199020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c197a0d-5937-40fa-85b2-6ad7216c73cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.199304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c197a0d-5937-40fa-85b2-6ad7216c73cd admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.200543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c197a0d-5937-40fa-85b2-6ad7216c73cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.202468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c197a0d-5937-40fa-85b2-6ad7216c73cd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.203481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a851a-f40f-4783-ac97-20a5901bc0b4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.208592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecebe32-c147-454d-9fa5-4c218b8f0f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.209221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebe32-c147-454d-9fa5-4c218b8f0f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.209502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebe32-c147-454d-9fa5-4c218b8f0f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.209776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecebe32-c147-454d-9fa5-4c218b8f0f4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.210491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecebe32-c147-454d-9fa5-4c218b8f0f4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:07:38.210826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecebe32-c147-454d-9fa5-4c218b8f0f4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.212455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecebe32-c147-454d-9fa5-4c218b8f0f4b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.225414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 786/1559] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:07:38.226212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecebe32-c147-454d-9fa5-4c218b8f0f4b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.229779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 774/1560] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.229779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e55223-06a2-449d-9e7f-36bf5f40a36e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.229779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e55223-06a2-449d-9e7f-36bf5f40a36e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.229779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e55223-06a2-449d-9e7f-36bf5f40a36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.242299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecebe32-c147-454d-9fa5-4c218b8f0f4b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.247020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edaa81-591c-4b0b-9979-8e3e1646a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.247679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edaa81-591c-4b0b-9979-8e3e1646a429 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.247957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edaa81-591c-4b0b-9979-8e3e1646a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.248227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edaa81-591c-4b0b-9979-8e3e1646a429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.248940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edaa81-591c-4b0b-9979-8e3e1646a429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.249084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-86e55223-06a2-449d-9e7f-36bf5f40a36e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:38.250276 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-86e55223-06a2-449d-9e7f-36bf5f40a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:38.250529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edaa81-591c-4b0b-9979-8e3e1646a429 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.258467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 775/1561] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:38.261917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 787/1562] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:38.262142 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570043-449e-49fe-bc99-f534012caa33 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.262440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570043-449e-49fe-bc99-f534012caa33 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.262744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570043-449e-49fe-bc99-f534012caa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.263140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5d00c-9903-4315-84f5-78a5a1be6d97 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.263427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5d00c-9903-4315-84f5-78a5a1be6d97 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.263698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5d00c-9903-4315-84f5-78a5a1be6d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.281664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-da570043-449e-49fe-bc99-f534012caa33 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:38.281842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d4a5d00c-9903-4315-84f5-78a5a1be6d97 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:38.282816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-da570043-449e-49fe-bc99-f534012caa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:38.282947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d4a5d00c-9903-4315-84f5-78a5a1be6d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:38.291299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 788/1563] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:38.292034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5d00c-9903-4315-84f5-78a5a1be6d97 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.295219 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 776/1564] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:38.296070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da570043-449e-49fe-bc99-f534012caa33 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.301096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5d00c-9903-4315-84f5-78a5a1be6d97 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.305171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da570043-449e-49fe-bc99-f534012caa33 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.305626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1e4a0-8061-4d6f-a8a2-f95c5613e730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.306271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1e4a0-8061-4d6f-a8a2-f95c5613e730 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.306591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1e4a0-8061-4d6f-a8a2-f95c5613e730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.306849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1e4a0-8061-4d6f-a8a2-f95c5613e730 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.307533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1e4a0-8061-4d6f-a8a2-f95c5613e730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.309422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1e4a0-8061-4d6f-a8a2-f95c5613e730 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.309808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e121858-7347-483e-b4a4-9f97f6de9eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.310510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121858-7347-483e-b4a4-9f97f6de9eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.310770 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121858-7347-483e-b4a4-9f97f6de9eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.311051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121858-7347-483e-b4a4-9f97f6de9eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.311772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e121858-7347-483e-b4a4-9f97f6de9eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:07:38.312077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e121858-7347-483e-b4a4-9f97f6de9eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.313662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e121858-7347-483e-b4a4-9f97f6de9eb5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.318183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:38.325988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 777/1565] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:07:38.331198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e121858-7347-483e-b4a4-9f97f6de9eb5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.337367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 789/1566] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.338283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1e4a0-8061-4d6f-a8a2-f95c5613e730 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.340581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e121858-7347-483e-b4a4-9f97f6de9eb5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.400213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2b75e-10d2-445d-a4bd-07c94be11d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.400878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2b75e-10d2-445d-a4bd-07c94be11d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.401168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2b75e-10d2-445d-a4bd-07c94be11d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.401443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2b75e-10d2-445d-a4bd-07c94be11d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.402171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2b75e-10d2-445d-a4bd-07c94be11d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.402490 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1e4a0-8061-4d6f-a8a2-f95c5613e730 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.403805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2b75e-10d2-445d-a4bd-07c94be11d4f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.407214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca7ae-2645-4a61-937a-92a3a8b6d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.407868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca7ae-2645-4a61-937a-92a3a8b6d861 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.408153 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca7ae-2645-4a61-937a-92a3a8b6d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.408438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca7ae-2645-4a61-937a-92a3a8b6d861 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.409157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cca7ae-2645-4a61-937a-92a3a8b6d861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.411089 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cca7ae-2645-4a61-937a-92a3a8b6d861 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.414257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 778/1567] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:38.415108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2b75e-10d2-445d-a4bd-07c94be11d4f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.425209 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2b75e-10d2-445d-a4bd-07c94be11d4f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.430020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f685c62-ad5f-4bf9-a0d0-26e385dc2ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.430656 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685c62-ad5f-4bf9-a0d0-26e385dc2ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.430970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685c62-ad5f-4bf9-a0d0-26e385dc2ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.431256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685c62-ad5f-4bf9-a0d0-26e385dc2ca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.431978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f685c62-ad5f-4bf9-a0d0-26e385dc2ca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:07:38.432289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f685c62-ad5f-4bf9-a0d0-26e385dc2ca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.433877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f685c62-ad5f-4bf9-a0d0-26e385dc2ca8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.437312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 790/1568] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.438279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca7ae-2645-4a61-937a-92a3a8b6d861 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.456601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 779/1569] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:07:38.456601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f685c62-ad5f-4bf9-a0d0-26e385dc2ca8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.460608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f685c62-ad5f-4bf9-a0d0-26e385dc2ca8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.499698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca7ae-2645-4a61-937a-92a3a8b6d861 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.505450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d4320-54ab-40f1-8f40-689b53c17227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.506317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d4320-54ab-40f1-8f40-689b53c17227 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.506602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d4320-54ab-40f1-8f40-689b53c17227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.507029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d4320-54ab-40f1-8f40-689b53c17227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.507800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d4320-54ab-40f1-8f40-689b53c17227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.509621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d4320-54ab-40f1-8f40-689b53c17227 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.515894 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8311dd-5ffb-4fb2-811a-2f5916ee74a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.516561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8311dd-5ffb-4fb2-811a-2f5916ee74a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.516847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8311dd-5ffb-4fb2-811a-2f5916ee74a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.517121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8311dd-5ffb-4fb2-811a-2f5916ee74a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.517838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8311dd-5ffb-4fb2-811a-2f5916ee74a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:07:38.519074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8311dd-5ffb-4fb2-811a-2f5916ee74a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.523591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 791/1570] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:38.523766 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8311dd-5ffb-4fb2-811a-2f5916ee74a7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.523902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d4320-54ab-40f1-8f40-689b53c17227 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.534296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 780/1571] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:07:38.534462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d4320-54ab-40f1-8f40-689b53c17227 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.535809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8311dd-5ffb-4fb2-811a-2f5916ee74a7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.539123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701af64a-ebbc-440c-b179-1a6d85fa66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.539782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701af64a-ebbc-440c-b179-1a6d85fa66ff admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.540137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701af64a-ebbc-440c-b179-1a6d85fa66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.540424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701af64a-ebbc-440c-b179-1a6d85fa66ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.541450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701af64a-ebbc-440c-b179-1a6d85fa66ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:07:38.541771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701af64a-ebbc-440c-b179-1a6d85fa66ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.543415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701af64a-ebbc-440c-b179-1a6d85fa66ff admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.545827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8311dd-5ffb-4fb2-811a-2f5916ee74a7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.550549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc9eda-0566-4f3e-9532-058f340d65a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.551222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc9eda-0566-4f3e-9532-058f340d65a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.551507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc9eda-0566-4f3e-9532-058f340d65a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.551781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc9eda-0566-4f3e-9532-058f340d65a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.552460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc9eda-0566-4f3e-9532-058f340d65a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.554348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc9eda-0566-4f3e-9532-058f340d65a1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.556179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 792/1572] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:07:38.556772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701af64a-ebbc-440c-b179-1a6d85fa66ff admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.569007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701af64a-ebbc-440c-b179-1a6d85fa66ff admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.574394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00724-59f4-4741-b4d4-d3272eeaf7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.575113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00724-59f4-4741-b4d4-d3272eeaf7de admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.575462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00724-59f4-4741-b4d4-d3272eeaf7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.575729 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00724-59f4-4741-b4d4-d3272eeaf7de admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.576441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c00724-59f4-4741-b4d4-d3272eeaf7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.577447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-07c00724-59f4-4741-b4d4-d3272eeaf7de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:07:38.577447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: warnings.warn(msg) May 23 18:07:38.577447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: May 23 18:07:38.578639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c00724-59f4-4741-b4d4-d3272eeaf7de admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.582388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 781/1573] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.583249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc9eda-0566-4f3e-9532-058f340d65a1 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.597383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:38.604163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 793/1574] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.604163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00724-59f4-4741-b4d4-d3272eeaf7de admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.612800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00724-59f4-4741-b4d4-d3272eeaf7de admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.651898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc9eda-0566-4f3e-9532-058f340d65a1 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.652987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:38.656574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc232-d5d3-4533-a88b-6d42dac38d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.657265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc232-d5d3-4533-a88b-6d42dac38d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.657524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc232-d5d3-4533-a88b-6d42dac38d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.657837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc232-d5d3-4533-a88b-6d42dac38d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.658624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc232-d5d3-4533-a88b-6d42dac38d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.660295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc232-d5d3-4533-a88b-6d42dac38d18 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.670429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 782/1575] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:38.671364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc232-d5d3-4533-a88b-6d42dac38d18 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.673870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003eaff-0146-4029-a7b7-32e8791dc04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.676570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003eaff-0146-4029-a7b7-32e8791dc04f admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.676927 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003eaff-0146-4029-a7b7-32e8791dc04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.677330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003eaff-0146-4029-a7b7-32e8791dc04f admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.678031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003eaff-0146-4029-a7b7-32e8791dc04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.679995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003eaff-0146-4029-a7b7-32e8791dc04f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.681991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc232-d5d3-4533-a88b-6d42dac38d18 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.686608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4716f6-d3e0-4343-9b3c-946fb97a00ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.687289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4716f6-d3e0-4343-9b3c-946fb97a00ee admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.687576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4716f6-d3e0-4343-9b3c-946fb97a00ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.687886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4716f6-d3e0-4343-9b3c-946fb97a00ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.688680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4716f6-d3e0-4343-9b3c-946fb97a00ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.691565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4716f6-d3e0-4343-9b3c-946fb97a00ee admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.702021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 794/1576] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.703024 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003eaff-0146-4029-a7b7-32e8791dc04f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.715936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003eaff-0146-4029-a7b7-32e8791dc04f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.720376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 783/1577] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.720565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c99f1-1687-4bcb-8163-cde45fd64eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.721212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4716f6-d3e0-4343-9b3c-946fb97a00ee admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.722247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c99f1-1687-4bcb-8163-cde45fd64eae admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.722532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c99f1-1687-4bcb-8163-cde45fd64eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.722846 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c99f1-1687-4bcb-8163-cde45fd64eae admin admin] PATH_INFO: `/v3/projects/67663c58bce243c7a6141d5d6da3322c/users/7e947a9f2fe24dae963621b64b9a3968/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.739787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c99f1-1687-4bcb-8163-cde45fd64eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=67663c58bce243c7a6141d5d6da3322c, user_id=7e947a9f2fe24dae963621b64b9a3968, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.742438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c99f1-1687-4bcb-8163-cde45fd64eae admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.756524 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 795/1578] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:38 2022] PUT /identity/v3/projects/67663c58bce243c7a6141d5d6da3322c/users/7e947a9f2fe24dae963621b64b9a3968/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:38.757610 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c99f1-1687-4bcb-8163-cde45fd64eae admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.789062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4716f6-d3e0-4343-9b3c-946fb97a00ee admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.820564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c99f1-1687-4bcb-8163-cde45fd64eae admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.825251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0170-3632-4061-af4e-65ed484738ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.825905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0170-3632-4061-af4e-65ed484738ba admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.826192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0170-3632-4061-af4e-65ed484738ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.826467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0170-3632-4061-af4e-65ed484738ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.827193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a0170-3632-4061-af4e-65ed484738ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.829093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a0170-3632-4061-af4e-65ed484738ba admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.849976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f26433-9dd6-4734-a984-fc2f08afec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.850639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f26433-9dd6-4734-a984-fc2f08afec4d admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.850965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f26433-9dd6-4734-a984-fc2f08afec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.851226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f26433-9dd6-4734-a984-fc2f08afec4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.851965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f26433-9dd6-4734-a984-fc2f08afec4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.853871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f26433-9dd6-4734-a984-fc2f08afec4d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.855947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 796/1579] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.856579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0170-3632-4061-af4e-65ed484738ba admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.883877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 784/1580] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/projects => generated 355 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:38.883877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f26433-9dd6-4734-a984-fc2f08afec4d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.900382 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:38.924787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0170-3632-4061-af4e-65ed484738ba admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.946084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f26433-9dd6-4734-a984-fc2f08afec4d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.950846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668283f-30bd-432f-97f4-948b9744a64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.951542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668283f-30bd-432f-97f4-948b9744a64a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.951871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668283f-30bd-432f-97f4-948b9744a64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.952129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668283f-30bd-432f-97f4-948b9744a64a admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.952881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668283f-30bd-432f-97f4-948b9744a64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.954566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668283f-30bd-432f-97f4-948b9744a64a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.958668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:38.968015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 785/1581] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:38.968015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668283f-30bd-432f-97f4-948b9744a64a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:38.975847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668283f-30bd-432f-97f4-948b9744a64a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:38.980468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297efca6-2d69-4466-8faf-215fdbf6ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.981348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297efca6-2d69-4466-8faf-215fdbf6ea76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.981638 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297efca6-2d69-4466-8faf-215fdbf6ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.981913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297efca6-2d69-4466-8faf-215fdbf6ea76 admin admin] PATH_INFO: `/v3/projects/74d48ee3a0df47dab968b0b92443648c/users/a57822c1558143d38ad17326a742c370/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.983682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101c714-f6f9-4d3f-a42d-ad2f35a770f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:38.984472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101c714-f6f9-4d3f-a42d-ad2f35a770f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:38.985001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101c714-f6f9-4d3f-a42d-ad2f35a770f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:38.985347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101c714-f6f9-4d3f-a42d-ad2f35a770f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:38.986104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101c714-f6f9-4d3f-a42d-ad2f35a770f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:38.988698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101c714-f6f9-4d3f-a42d-ad2f35a770f1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:38.999031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297efca6-2d69-4466-8faf-215fdbf6ea76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d48ee3a0df47dab968b0b92443648c, user_id=a57822c1558143d38ad17326a742c370, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.000173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-297efca6-2d69-4466-8faf-215fdbf6ea76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:07:39.000173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: warnings.warn(msg) May 23 18:07:39.000173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: May 23 18:07:39.002334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297efca6-2d69-4466-8faf-215fdbf6ea76 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.010654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 797/1582] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:38 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:39.011631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101c714-f6f9-4d3f-a42d-ad2f35a770f1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.017043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 786/1583] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:38 2022] PUT /identity/v3/projects/74d48ee3a0df47dab968b0b92443648c/users/a57822c1558143d38ad17326a742c370/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:39.017986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297efca6-2d69-4466-8faf-215fdbf6ea76 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.024693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101c714-f6f9-4d3f-a42d-ad2f35a770f1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.080041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297efca6-2d69-4466-8faf-215fdbf6ea76 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.084458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc327-8bac-4d27-9ff9-34cf7c5a9cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.084631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96807440-577c-40bf-89d1-f0eb44a13d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.085235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc327-8bac-4d27-9ff9-34cf7c5a9cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.085339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96807440-577c-40bf-89d1-f0eb44a13d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.085518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96807440-577c-40bf-89d1-f0eb44a13d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.085616 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc327-8bac-4d27-9ff9-34cf7c5a9cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.085802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc327-8bac-4d27-9ff9-34cf7c5a9cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.085925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96807440-577c-40bf-89d1-f0eb44a13d8f admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.086477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96807440-577c-40bf-89d1-f0eb44a13d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.086597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfc327-8bac-4d27-9ff9-34cf7c5a9cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.088121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfc327-8bac-4d27-9ff9-34cf7c5a9cc7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.088438 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96807440-577c-40bf-89d1-f0eb44a13d8f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.101436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 798/1584] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.101436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a75e-5308-4197-af56-7dc91ea9f865 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.101436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a75e-5308-4197-af56-7dc91ea9f865 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.101436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a75e-5308-4197-af56-7dc91ea9f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.113657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 787/1585] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:39 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:39.114498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96807440-577c-40bf-89d1-f0eb44a13d8f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.124359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96807440-577c-40bf-89d1-f0eb44a13d8f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.129109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b325d-2074-4538-9654-a8bdf34e08ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.129767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b325d-2074-4538-9654-a8bdf34e08ce admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.130055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b325d-2074-4538-9654-a8bdf34e08ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.130333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b325d-2074-4538-9654-a8bdf34e08ce admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.131052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b325d-2074-4538-9654-a8bdf34e08ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.131173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8df0a75e-5308-4197-af56-7dc91ea9f865 None None] MFA Rules not processed for user `7e947a9f2fe24dae963621b64b9a3968`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:39.132712 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8df0a75e-5308-4197-af56-7dc91ea9f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:39.132980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b325d-2074-4538-9654-a8bdf34e08ce admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.153890 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 788/1586] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:39 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:39.154793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b325d-2074-4538-9654-a8bdf34e08ce admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.164804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b325d-2074-4538-9654-a8bdf34e08ce admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.169341 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24cc2-d67e-4f98-a49b-367be673806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.169989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24cc2-d67e-4f98-a49b-367be673806b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.170272 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24cc2-d67e-4f98-a49b-367be673806b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.170545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24cc2-d67e-4f98-a49b-367be673806b admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.171254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24cc2-d67e-4f98-a49b-367be673806b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.173155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24cc2-d67e-4f98-a49b-367be673806b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.193448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 789/1587] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:39 2022] POST /identity/v3/users => generated 278 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:39.194602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24cc2-d67e-4f98-a49b-367be673806b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.201751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 799/1588] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:39.202587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0a75e-5308-4197-af56-7dc91ea9f865 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.204425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24cc2-d67e-4f98-a49b-367be673806b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.213863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2a200-32e0-4296-8482-fde869c4411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.214878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2a200-32e0-4296-8482-fde869c4411e admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.215255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2a200-32e0-4296-8482-fde869c4411e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.215652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2a200-32e0-4296-8482-fde869c4411e admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.215748 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0a75e-5308-4197-af56-7dc91ea9f865 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.216716 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2a200-32e0-4296-8482-fde869c4411e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.218690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2a200-32e0-4296-8482-fde869c4411e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.221966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62317f6d-8def-4802-b931-a25dee581eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.222782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62317f6d-8def-4802-b931-a25dee581eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.223155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62317f6d-8def-4802-b931-a25dee581eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.223394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62317f6d-8def-4802-b931-a25dee581eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.224125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62317f6d-8def-4802-b931-a25dee581eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.225715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62317f6d-8def-4802-b931-a25dee581eaa admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.230425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 790/1589] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.231721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273f6a3-6668-49bf-9605-f91410281bd7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.232068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273f6a3-6668-49bf-9605-f91410281bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.232359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273f6a3-6668-49bf-9605-f91410281bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.245885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 800/1590] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.245885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62317f6d-8def-4802-b931-a25dee581eaa admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.251811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8273f6a3-6668-49bf-9605-f91410281bd7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:39.253257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8273f6a3-6668-49bf-9605-f91410281bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:39.255611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62317f6d-8def-4802-b931-a25dee581eaa admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.261277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c9d2c-7891-488e-b68b-9e2e330cffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.264933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 791/1591] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:39.265046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c9d2c-7891-488e-b68b-9e2e330cffe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.265136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273f6a3-6668-49bf-9605-f91410281bd7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.265215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c9d2c-7891-488e-b68b-9e2e330cffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.265215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c9d2c-7891-488e-b68b-9e2e330cffe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.265215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c9d2c-7891-488e-b68b-9e2e330cffe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.265215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c9d2c-7891-488e-b68b-9e2e330cffe3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.272524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273f6a3-6668-49bf-9605-f91410281bd7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.277257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16288f-d952-45b7-b821-fc01a96f71a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.277925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16288f-d952-45b7-b821-fc01a96f71a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.278207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16288f-d952-45b7-b821-fc01a96f71a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.278479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16288f-d952-45b7-b821-fc01a96f71a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.279231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16288f-d952-45b7-b821-fc01a96f71a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.280809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16288f-d952-45b7-b821-fc01a96f71a4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.289748 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 801/1592] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.290668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c9d2c-7891-488e-b68b-9e2e330cffe3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.291957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 792/1593] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.292891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16288f-d952-45b7-b821-fc01a96f71a4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.302003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c9d2c-7891-488e-b68b-9e2e330cffe3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.303333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16288f-d952-45b7-b821-fc01a96f71a4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.306659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f4beb-b29f-49ea-bfa1-1aa54f8f90c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.307360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f4beb-b29f-49ea-bfa1-1aa54f8f90c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.307648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f4beb-b29f-49ea-bfa1-1aa54f8f90c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.307794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5779e-2848-445e-955a-3b33659c104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.307918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f4beb-b29f-49ea-bfa1-1aa54f8f90c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.308356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5779e-2848-445e-955a-3b33659c104b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.308629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f4beb-b29f-49ea-bfa1-1aa54f8f90c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.308745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5779e-2848-445e-955a-3b33659c104b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.308901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5779e-2848-445e-955a-3b33659c104b admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.309648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5779e-2848-445e-955a-3b33659c104b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.310215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f4beb-b29f-49ea-bfa1-1aa54f8f90c7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.311236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5779e-2848-445e-955a-3b33659c104b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.321434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 802/1594] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.324710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 793/1595] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.324710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5779e-2848-445e-955a-3b33659c104b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.324935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed344f7-01b2-4323-b066-12b31ad5e55e None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.324935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed344f7-01b2-4323-b066-12b31ad5e55e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.324935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed344f7-01b2-4323-b066-12b31ad5e55e None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.325478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 803/1596] 10.222.0.30 () {54 vars in 961 bytes} [Mon May 23 18:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:07:39.326213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed344f7-01b2-4323-b066-12b31ad5e55e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.331046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:39.334780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5779e-2848-445e-955a-3b33659c104b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.339623 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed344f7-01b2-4323-b066-12b31ad5e55e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.340651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4755-e2ce-441e-8cd4-d07919813267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.341940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4755-e2ce-441e-8cd4-d07919813267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.342224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4755-e2ce-441e-8cd4-d07919813267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.342499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4755-e2ce-441e-8cd4-d07919813267 admin admin] PATH_INFO: `/v3/projects/c69b4fff47194d4fbd1188521b31dce8/users/32e9879d092b4c819f1f5607f42cc364/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.344122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf31d8-ae22-499a-883d-76810102cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.344764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf31d8-ae22-499a-883d-76810102cc05 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.345043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf31d8-ae22-499a-883d-76810102cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.345315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf31d8-ae22-499a-883d-76810102cc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.346537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf31d8-ae22-499a-883d-76810102cc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.348134 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf31d8-ae22-499a-883d-76810102cc05 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.358228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4755-e2ce-441e-8cd4-d07919813267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69b4fff47194d4fbd1188521b31dce8, user_id=32e9879d092b4c819f1f5607f42cc364, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.358863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 804/1597] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.359551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf31d8-ae22-499a-883d-76810102cc05 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.360915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f4755-e2ce-441e-8cd4-d07919813267 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.370387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:39.376943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 794/1598] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:39 2022] PUT /identity/v3/projects/c69b4fff47194d4fbd1188521b31dce8/users/32e9879d092b4c819f1f5607f42cc364/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:39.377910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4755-e2ce-441e-8cd4-d07919813267 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.419382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf31d8-ae22-499a-883d-76810102cc05 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.440825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4755-e2ce-441e-8cd4-d07919813267 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.445453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b606599-fbf5-4ac3-a1f1-cf83ddb1b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.446342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b606599-fbf5-4ac3-a1f1-cf83ddb1b2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.446628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b606599-fbf5-4ac3-a1f1-cf83ddb1b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.446939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b606599-fbf5-4ac3-a1f1-cf83ddb1b2f5 admin admin] PATH_INFO: `/v3/projects/e00ef21138204550843697c5f33a8999/users/8d08ba344a9349d99de16520d3ce5150/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.462157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b606599-fbf5-4ac3-a1f1-cf83ddb1b2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00ef21138204550843697c5f33a8999, user_id=8d08ba344a9349d99de16520d3ce5150, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.464859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b606599-fbf5-4ac3-a1f1-cf83ddb1b2f5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.468516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda7cb3-c7e2-4d84-a62f-1947e2e0a4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.469169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7cb3-c7e2-4d84-a62f-1947e2e0a4bd service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.469456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7cb3-c7e2-4d84-a62f-1947e2e0a4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.469727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7cb3-c7e2-4d84-a62f-1947e2e0a4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.479436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 795/1599] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:39 2022] PUT /identity/v3/projects/e00ef21138204550843697c5f33a8999/users/8d08ba344a9349d99de16520d3ce5150/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:39.479585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda7cb3-c7e2-4d84-a62f-1947e2e0a4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.480248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b606599-fbf5-4ac3-a1f1-cf83ddb1b2f5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.480984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda7cb3-c7e2-4d84-a62f-1947e2e0a4bd service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.490845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 805/1600] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:39.491605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda7cb3-c7e2-4d84-a62f-1947e2e0a4bd service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.500393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda7cb3-c7e2-4d84-a62f-1947e2e0a4bd service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.548120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b606599-fbf5-4ac3-a1f1-cf83ddb1b2f5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.552940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f0d0e-e099-4f65-83da-895d95d82649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.553620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f0d0e-e099-4f65-83da-895d95d82649 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.553909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f0d0e-e099-4f65-83da-895d95d82649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.554188 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f0d0e-e099-4f65-83da-895d95d82649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.554944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f0d0e-e099-4f65-83da-895d95d82649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.556575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f0d0e-e099-4f65-83da-895d95d82649 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.567147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 796/1601] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.567932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f0d0e-e099-4f65-83da-895d95d82649 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.573142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78785ce7-47e5-425f-ba6f-c1475dd8bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.574625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78785ce7-47e5-425f-ba6f-c1475dd8bf6c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.575141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78785ce7-47e5-425f-ba6f-c1475dd8bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.575629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78785ce7-47e5-425f-ba6f-c1475dd8bf6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.576569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78785ce7-47e5-425f-ba6f-c1475dd8bf6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.578605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78785ce7-47e5-425f-ba6f-c1475dd8bf6c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.579936 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f0d0e-e099-4f65-83da-895d95d82649 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.586144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7b7f8-9b55-4169-8b4b-92fd0fbad887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.586450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7b7f8-9b55-4169-8b4b-92fd0fbad887 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.586838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7b7f8-9b55-4169-8b4b-92fd0fbad887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.587166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7b7f8-9b55-4169-8b4b-92fd0fbad887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.587940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7b7f8-9b55-4169-8b4b-92fd0fbad887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.589537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7b7f8-9b55-4169-8b4b-92fd0fbad887 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.592543 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 806/1602] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.594864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73b45a-29cb-4c6b-8d60-78cb28c0ad9c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.595314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73b45a-29cb-4c6b-8d60-78cb28c0ad9c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.595850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73b45a-29cb-4c6b-8d60-78cb28c0ad9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.614264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 797/1603] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:39.615271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7b7f8-9b55-4169-8b4b-92fd0fbad887 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.618552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2d73b45a-29cb-4c6b-8d60-78cb28c0ad9c None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:39.620091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2d73b45a-29cb-4c6b-8d60-78cb28c0ad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:39.628852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7b7f8-9b55-4169-8b4b-92fd0fbad887 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.634529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50685b9-e83f-496d-b10a-348641240ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.635667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50685b9-e83f-496d-b10a-348641240ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.635864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50685b9-e83f-496d-b10a-348641240ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.636258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50685b9-e83f-496d-b10a-348641240ee7 admin admin] PATH_INFO: `/v3/projects/d8fd05bc2bd044538e2f547cbd339e96/users/a53e04638f5e4933b8843433230fc396/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.653782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50685b9-e83f-496d-b10a-348641240ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fd05bc2bd044538e2f547cbd339e96, user_id=a53e04638f5e4933b8843433230fc396, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.656767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50685b9-e83f-496d-b10a-348641240ee7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.677405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 798/1604] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:39 2022] PUT /identity/v3/projects/d8fd05bc2bd044538e2f547cbd339e96/users/a53e04638f5e4933b8843433230fc396/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:39.678743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881c7f7-ec0f-43da-9df1-07b73e2b9d7a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.679039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881c7f7-ec0f-43da-9df1-07b73e2b9d7a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.679347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881c7f7-ec0f-43da-9df1-07b73e2b9d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.703755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1881c7f7-ec0f-43da-9df1-07b73e2b9d7a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:39.705463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1881c7f7-ec0f-43da-9df1-07b73e2b9d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:39.715568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:39.730604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:39.736383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 807/1605] 10.222.0.30 () {58 vars in 1058 bytes} [Mon May 23 18:07:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:39.738750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001709f-d13f-4f06-8da7-d58aa10c1adb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.739236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001709f-d13f-4f06-8da7-d58aa10c1adb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.739783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001709f-d13f-4f06-8da7-d58aa10c1adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.760434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8001709f-d13f-4f06-8da7-d58aa10c1adb None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:39.762453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8001709f-d13f-4f06-8da7-d58aa10c1adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:39.790237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 799/1606] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:39.790237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881c7f7-ec0f-43da-9df1-07b73e2b9d7a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.798078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881c7f7-ec0f-43da-9df1-07b73e2b9d7a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.803279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f81fa-57a9-4692-b8ea-3e20d3b7a9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.804165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f81fa-57a9-4692-b8ea-3e20d3b7a9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.804692 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f81fa-57a9-4692-b8ea-3e20d3b7a9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.804975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f81fa-57a9-4692-b8ea-3e20d3b7a9c9 admin admin] PATH_INFO: `/v3/projects/b3e941f449f34bcaa50de8b5d87b9389/users/38349aaa207c4703a18f512ad2f95196/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.824072 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f81fa-57a9-4692-b8ea-3e20d3b7a9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e941f449f34bcaa50de8b5d87b9389, user_id=38349aaa207c4703a18f512ad2f95196, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.827510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f81fa-57a9-4692-b8ea-3e20d3b7a9c9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.836219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 808/1607] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:39.836978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001709f-d13f-4f06-8da7-d58aa10c1adb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.847323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 800/1608] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:39 2022] PUT /identity/v3/projects/b3e941f449f34bcaa50de8b5d87b9389/users/38349aaa207c4703a18f512ad2f95196/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:39.848162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f81fa-57a9-4692-b8ea-3e20d3b7a9c9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:39.857909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001709f-d13f-4f06-8da7-d58aa10c1adb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.931030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f81fa-57a9-4692-b8ea-3e20d3b7a9c9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:39.935786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968796b-1970-4dfc-9d38-d4c4ff0067ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.936795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968796b-1970-4dfc-9d38-d4c4ff0067ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.937074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968796b-1970-4dfc-9d38-d4c4ff0067ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.937668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968796b-1970-4dfc-9d38-d4c4ff0067ab admin admin] PATH_INFO: `/v3/projects/969814a1819041d7bc3b5cda7c3d54f5/users/02914e2a1ab84a39be16053182906718/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.942618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529910-f41a-49f5-a88f-ebd7f95ceb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:39.944721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529910-f41a-49f5-a88f-ebd7f95ceb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.945079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529910-f41a-49f5-a88f-ebd7f95ceb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.945433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529910-f41a-49f5-a88f-ebd7f95ceb1f admin admin] PATH_INFO: `/v3/projects/3713cd2e1a9449028392f2120ad3314d/users/b6ea646b555a4f849c87c929118492b1/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.956955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968796b-1970-4dfc-9d38-d4c4ff0067ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=969814a1819041d7bc3b5cda7c3d54f5, user_id=02914e2a1ab84a39be16053182906718, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.960057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968796b-1970-4dfc-9d38-d4c4ff0067ab admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.965794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea529910-f41a-49f5-a88f-ebd7f95ceb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3713cd2e1a9449028392f2120ad3314d, user_id=b6ea646b555a4f849c87c929118492b1, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:39.969034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea529910-f41a-49f5-a88f-ebd7f95ceb1f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:39.981635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 801/1609] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:39 2022] PUT /identity/v3/projects/969814a1819041d7bc3b5cda7c3d54f5/users/02914e2a1ab84a39be16053182906718/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:39.982986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f4fc6-5d91-4bf0-b717-7aa161c13bdc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:39.983282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f4fc6-5d91-4bf0-b717-7aa161c13bdc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:39.983567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f4fc6-5d91-4bf0-b717-7aa161c13bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:39.994314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 809/1610] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:39 2022] PUT /identity/v3/projects/3713cd2e1a9449028392f2120ad3314d/users/b6ea646b555a4f849c87c929118492b1/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:39.995269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529910-f41a-49f5-a88f-ebd7f95ceb1f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:40.027999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-be1f4fc6-5d91-4bf0-b717-7aa161c13bdc None None] MFA Rules not processed for user `a53e04638f5e4933b8843433230fc396`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:40.029302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-be1f4fc6-5d91-4bf0-b717-7aa161c13bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:40.078942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529910-f41a-49f5-a88f-ebd7f95ceb1f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:40.085584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cc493-864b-4e83-b7fc-2544950b7618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:40.086806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cc493-864b-4e83-b7fc-2544950b7618 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.087118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cc493-864b-4e83-b7fc-2544950b7618 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.087470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cc493-864b-4e83-b7fc-2544950b7618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.102341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:40.106836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 802/1611] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:40.110521 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f4fc6-5d91-4bf0-b717-7aa161c13bdc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:40.110521 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-be1f4fc6-5d91-4bf0-b717-7aa161c13bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:40.131068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:40.151329 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cc493-864b-4e83-b7fc-2544950b7618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:40.153074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cc493-864b-4e83-b7fc-2544950b7618 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:40.166012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 810/1612] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:40.166876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cc493-864b-4e83-b7fc-2544950b7618 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:40.168264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-198cc493-864b-4e83-b7fc-2544950b7618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:40.200205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f4fc6-5d91-4bf0-b717-7aa161c13bdc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:40.204601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95523ca4-cfd2-4a85-a9b6-5d21980f30a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:40.205292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95523ca4-cfd2-4a85-a9b6-5d21980f30a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.206480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95523ca4-cfd2-4a85-a9b6-5d21980f30a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.207050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95523ca4-cfd2-4a85-a9b6-5d21980f30a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.369741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95523ca4-cfd2-4a85-a9b6-5d21980f30a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:40.371632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95523ca4-cfd2-4a85-a9b6-5d21980f30a2 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:40.411120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 803/1613] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:40.413109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ec7de-672a-4c50-a5d1-c9bdb0ce7567 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.413644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ec7de-672a-4c50-a5d1-c9bdb0ce7567 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.414152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ec7de-672a-4c50-a5d1-c9bdb0ce7567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.430752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cc493-864b-4e83-b7fc-2544950b7618 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:40.434877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0e9ec7de-672a-4c50-a5d1-c9bdb0ce7567 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:40.437141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0e9ec7de-672a-4c50-a5d1-c9bdb0ce7567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:40.443736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d1931-64fa-4a00-990f-164c845b578e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:40.445765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d1931-64fa-4a00-990f-164c845b578e service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.446529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d1931-64fa-4a00-990f-164c845b578e service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.446923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d1931-64fa-4a00-990f-164c845b578e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.448451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 804/1614] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:40.450071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c058c-4d4d-4d25-b57f-c6537f91ab0c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.450598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c058c-4d4d-4d25-b57f-c6537f91ab0c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.451221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c058c-4d4d-4d25-b57f-c6537f91ab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.463735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d1931-64fa-4a00-990f-164c845b578e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:40.466001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d1931-64fa-4a00-990f-164c845b578e service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:40.478576 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 811/1615] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:40.480281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ad57a-2e03-46e8-8b24-15c0e6439f34 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.480732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ad57a-2e03-46e8-8b24-15c0e6439f34 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.481198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ad57a-2e03-46e8-8b24-15c0e6439f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.486022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c36c058c-4d4d-4d25-b57f-c6537f91ab0c None None] MFA Rules not processed for user `02914e2a1ab84a39be16053182906718`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:40.488510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c36c058c-4d4d-4d25-b57f-c6537f91ab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:40.512159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2a7ad57a-2e03-46e8-8b24-15c0e6439f34 None None] MFA Rules not processed for user `b6ea646b555a4f849c87c929118492b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:40.513628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2a7ad57a-2e03-46e8-8b24-15c0e6439f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:40.597873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 805/1616] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:40 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:40.598836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c058c-4d4d-4d25-b57f-c6537f91ab0c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:40.614365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c058c-4d4d-4d25-b57f-c6537f91ab0c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:40.621779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275fcbf-a4cf-43cc-841c-f0d779b58dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:40.622496 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275fcbf-a4cf-43cc-841c-f0d779b58dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.622811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275fcbf-a4cf-43cc-841c-f0d779b58dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.623140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275fcbf-a4cf-43cc-841c-f0d779b58dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.623962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275fcbf-a4cf-43cc-841c-f0d779b58dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:40.627085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275fcbf-a4cf-43cc-841c-f0d779b58dd9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:40.670494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 806/1617] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:40 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:40.672917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914782ba-1bab-4cde-a4db-a387c3a81bb8 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.673055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 812/1618] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:40.673511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914782ba-1bab-4cde-a4db-a387c3a81bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.673511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914782ba-1bab-4cde-a4db-a387c3a81bb8 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.673912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ad57a-2e03-46e8-8b24-15c0e6439f34 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:40.680482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 807/1619] 10.222.0.30 () {54 vars in 912 bytes} [Mon May 23 18:07:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:07:40.681364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914782ba-1bab-4cde-a4db-a387c3a81bb8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:40.704126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ad57a-2e03-46e8-8b24-15c0e6439f34 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:40.724511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:40.786279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914782ba-1bab-4cde-a4db-a387c3a81bb8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:40.801302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3a3a0-8ea2-4628-9086-1c589daec85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:40.803328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3a3a0-8ea2-4628-9086-1c589daec85e admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.803971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3a3a0-8ea2-4628-9086-1c589daec85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.804654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3a3a0-8ea2-4628-9086-1c589daec85e admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.805749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3a3a0-8ea2-4628-9086-1c589daec85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:40.808562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3a3a0-8ea2-4628-9086-1c589daec85e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:40.817828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:40.825208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7287b3-7bc9-4b20-9b93-440be23d90bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:40.825951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7287b3-7bc9-4b20-9b93-440be23d90bc service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.826331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7287b3-7bc9-4b20-9b93-440be23d90bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.827948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7287b3-7bc9-4b20-9b93-440be23d90bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.841161 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7287b3-7bc9-4b20-9b93-440be23d90bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:40.842081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 808/1620] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:40 2022] POST /identity/v3/projects => generated 353 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:40.842946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7287b3-7bc9-4b20-9b93-440be23d90bc service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:40.843236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3a3a0-8ea2-4628-9086-1c589daec85e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:40.865289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 813/1621] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:40.869204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7287b3-7bc9-4b20-9b93-440be23d90bc service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:40.890856 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7287b3-7bc9-4b20-9b93-440be23d90bc service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:40.934082 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3a3a0-8ea2-4628-9086-1c589daec85e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:40.948556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2523fa-edb9-4966-aa2d-79df7aba601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:40.949031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2523fa-edb9-4966-aa2d-79df7aba601b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.949324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2523fa-edb9-4966-aa2d-79df7aba601b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.949624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2523fa-edb9-4966-aa2d-79df7aba601b admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.950323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2523fa-edb9-4966-aa2d-79df7aba601b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:40.952564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2523fa-edb9-4966-aa2d-79df7aba601b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:40.983722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 809/1622] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:40 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:40.983722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10578c-06d7-4708-b0ed-c1a7f00eaded None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:40.983722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10578c-06d7-4708-b0ed-c1a7f00eaded None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:40.983722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10578c-06d7-4708-b0ed-c1a7f00eaded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:40.998403 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc2772-1ab6-465e-9d73-b14f712b5127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:40.999558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc2772-1ab6-465e-9d73-b14f712b5127 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:41.000868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc2772-1ab6-465e-9d73-b14f712b5127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:41.001366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc2772-1ab6-465e-9d73-b14f712b5127 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:41.004120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc2772-1ab6-465e-9d73-b14f712b5127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:41.007350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc2772-1ab6-465e-9d73-b14f712b5127 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:41.010420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2b10578c-06d7-4708-b0ed-c1a7f00eaded None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:41.011824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2b10578c-06d7-4708-b0ed-c1a7f00eaded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:41.064412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 814/1623] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:40 2022] POST /identity/v3/projects => generated 363 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:41.069643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc2772-1ab6-465e-9d73-b14f712b5127 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:41.145419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 810/1624] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:07:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:41.146939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10578c-06d7-4708-b0ed-c1a7f00eaded None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:41.163313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10578c-06d7-4708-b0ed-c1a7f00eaded None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:41.234247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc2772-1ab6-465e-9d73-b14f712b5127 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:41.235869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:41.263629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6688ce-d7e3-42c0-9d53-b8c6fc690b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:41.266067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6688ce-d7e3-42c0-9d53-b8c6fc690b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:41.266874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6688ce-d7e3-42c0-9d53-b8c6fc690b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:41.267166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6688ce-d7e3-42c0-9d53-b8c6fc690b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:41.271460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6688ce-d7e3-42c0-9d53-b8c6fc690b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:41.277567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6688ce-d7e3-42c0-9d53-b8c6fc690b20 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:41.346758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 815/1625] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:41 2022] POST /identity/v3/users => generated 283 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:41.346999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcf71c-c3d8-44d1-9da7-11349de2a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:41.346999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf71c-c3d8-44d1-9da7-11349de2a329 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:41.347981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6688ce-d7e3-42c0-9d53-b8c6fc690b20 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:41.348953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf71c-c3d8-44d1-9da7-11349de2a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:41.350980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf71c-c3d8-44d1-9da7-11349de2a329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:41.354573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcf71c-c3d8-44d1-9da7-11349de2a329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:41.363559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcf71c-c3d8-44d1-9da7-11349de2a329 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:41.385605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6688ce-d7e3-42c0-9d53-b8c6fc690b20 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:41.413216 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 811/1626] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:41.414252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcf71c-c3d8-44d1-9da7-11349de2a329 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:41.415774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2976b-8cea-4a38-8874-48e0a512d804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:41.418531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2976b-8cea-4a38-8874-48e0a512d804 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:41.422046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2976b-8cea-4a38-8874-48e0a512d804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:41.422532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2976b-8cea-4a38-8874-48e0a512d804 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:41.423312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2976b-8cea-4a38-8874-48e0a512d804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:41.432335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2976b-8cea-4a38-8874-48e0a512d804 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:41.472810 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 816/1627] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:41 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:41.473868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2976b-8cea-4a38-8874-48e0a512d804 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:41.495510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2976b-8cea-4a38-8874-48e0a512d804 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:41.505380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56033a-5e9b-4d0d-a1e0-f0917907603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:41.512776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56033a-5e9b-4d0d-a1e0-f0917907603e admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:41.512776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56033a-5e9b-4d0d-a1e0-f0917907603e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:41.512776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56033a-5e9b-4d0d-a1e0-f0917907603e admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:41.512776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56033a-5e9b-4d0d-a1e0-f0917907603e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:41.524214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56033a-5e9b-4d0d-a1e0-f0917907603e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:41.531201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcf71c-c3d8-44d1-9da7-11349de2a329 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:41.541892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e48da3-ba25-4327-abe0-7b9b8f8d6e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:41.543735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e48da3-ba25-4327-abe0-7b9b8f8d6e2a service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:41.544258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e48da3-ba25-4327-abe0-7b9b8f8d6e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:41.546002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e48da3-ba25-4327-abe0-7b9b8f8d6e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:41.556119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 817/1628] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:41.557052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56033a-5e9b-4d0d-a1e0-f0917907603e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:41.570734 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56033a-5e9b-4d0d-a1e0-f0917907603e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:41.577276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e996-bcd1-4104-a055-f8b56733fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:41.578236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e996-bcd1-4104-a055-f8b56733fc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:41.579046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e996-bcd1-4104-a055-f8b56733fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:41.579446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e996-bcd1-4104-a055-f8b56733fc9e admin admin] PATH_INFO: `/v3/projects/5cab92b5736248ff9f541c77e47e4232/users/c7e35268186d4fb89cadb7e4edf40ea9/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:41.601746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e996-bcd1-4104-a055-f8b56733fc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cab92b5736248ff9f541c77e47e4232, user_id=c7e35268186d4fb89cadb7e4edf40ea9, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:41.604887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e996-bcd1-4104-a055-f8b56733fc9e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:41.627097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 818/1629] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:41 2022] PUT /identity/v3/projects/5cab92b5736248ff9f541c77e47e4232/users/c7e35268186d4fb89cadb7e4edf40ea9/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:41.627097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e996-bcd1-4104-a055-f8b56733fc9e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:41.643890 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:41.751666 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e996-bcd1-4104-a055-f8b56733fc9e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:41.759231 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5bfce-b7da-4ccd-a88b-7b7761556f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:41.759971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5bfce-b7da-4ccd-a88b-7b7761556f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:41.760255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5bfce-b7da-4ccd-a88b-7b7761556f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:41.760535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5bfce-b7da-4ccd-a88b-7b7761556f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:41.761269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5bfce-b7da-4ccd-a88b-7b7761556f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:41.762979 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5bfce-b7da-4ccd-a88b-7b7761556f02 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:41.778833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 819/1630] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:41.778833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5bfce-b7da-4ccd-a88b-7b7761556f02 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:41.780507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e48da3-ba25-4327-abe0-7b9b8f8d6e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:41.782375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e48da3-ba25-4327-abe0-7b9b8f8d6e2a service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:41.789761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5bfce-b7da-4ccd-a88b-7b7761556f02 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:41.795374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff7620-8138-4960-b3c9-ae26612a887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:41.796798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff7620-8138-4960-b3c9-ae26612a887b admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:41.796798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff7620-8138-4960-b3c9-ae26612a887b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:41.797078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff7620-8138-4960-b3c9-ae26612a887b admin admin] PATH_INFO: `/v3/projects/13d74e1fbdfa422b98a7ce15938b7326/users/5f0cec08ea1d425fa69ddce602785a6b/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:41.818779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff7620-8138-4960-b3c9-ae26612a887b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d74e1fbdfa422b98a7ce15938b7326, user_id=5f0cec08ea1d425fa69ddce602785a6b, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:41.822082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff7620-8138-4960-b3c9-ae26612a887b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:41.844755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 812/1631] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:41.850967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e48da3-ba25-4327-abe0-7b9b8f8d6e2a service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:41.857535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 820/1632] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:41 2022] PUT /identity/v3/projects/13d74e1fbdfa422b98a7ce15938b7326/users/5f0cec08ea1d425fa69ddce602785a6b/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:41.862310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff7620-8138-4960-b3c9-ae26612a887b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:41.884593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e48da3-ba25-4327-abe0-7b9b8f8d6e2a service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:42.082048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff7620-8138-4960-b3c9-ae26612a887b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:42.103745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2d563-a62d-4e39-82d1-0a2f3c9e04e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:42.104672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2d563-a62d-4e39-82d1-0a2f3c9e04e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:42.104959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2d563-a62d-4e39-82d1-0a2f3c9e04e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:42.105241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2d563-a62d-4e39-82d1-0a2f3c9e04e9 admin admin] PATH_INFO: `/v3/projects/74951432ebaf46e28c7c70315450e645/users/223b3d6ae5c24a8e9e1ba02ee0ebc410/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:42.106638 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f55109-e243-4602-aad4-b0eaed5c2356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:42.107429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55109-e243-4602-aad4-b0eaed5c2356 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:42.107728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55109-e243-4602-aad4-b0eaed5c2356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:42.108006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55109-e243-4602-aad4-b0eaed5c2356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:42.108750 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f55109-e243-4602-aad4-b0eaed5c2356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:42.112833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f55109-e243-4602-aad4-b0eaed5c2356 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:42.147836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 813/1633] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:42.148835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f55109-e243-4602-aad4-b0eaed5c2356 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:42.161191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2d563-a62d-4e39-82d1-0a2f3c9e04e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74951432ebaf46e28c7c70315450e645, user_id=223b3d6ae5c24a8e9e1ba02ee0ebc410, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:42.170808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2d563-a62d-4e39-82d1-0a2f3c9e04e9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:42.173563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:42.186133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f55109-e243-4602-aad4-b0eaed5c2356 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:42.216940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89076c14-b469-4400-ab79-bc9467959105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:42.217632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89076c14-b469-4400-ab79-bc9467959105 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:42.217903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89076c14-b469-4400-ab79-bc9467959105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:42.218176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89076c14-b469-4400-ab79-bc9467959105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:42.218937 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89076c14-b469-4400-ab79-bc9467959105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:42.220552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89076c14-b469-4400-ab79-bc9467959105 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:42.227020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 821/1634] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:41 2022] PUT /identity/v3/projects/74951432ebaf46e28c7c70315450e645/users/223b3d6ae5c24a8e9e1ba02ee0ebc410/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:42.228760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2d563-a62d-4e39-82d1-0a2f3c9e04e9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:42.246354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 814/1635] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:42.250047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89076c14-b469-4400-ab79-bc9467959105 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:42.287123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89076c14-b469-4400-ab79-bc9467959105 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:42.399382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2d563-a62d-4e39-82d1-0a2f3c9e04e9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:42.411529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecc3aa-ae65-4db9-a0b7-d37fe045e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:42.412586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc3aa-ae65-4db9-a0b7-d37fe045e98b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:42.413085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc3aa-ae65-4db9-a0b7-d37fe045e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:42.413216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d9c49-f895-460c-964d-216e83ebd6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:42.413667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc3aa-ae65-4db9-a0b7-d37fe045e98b admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:42.414116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9c49-f895-460c-964d-216e83ebd6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:42.414402 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9c49-f895-460c-964d-216e83ebd6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:42.414679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9c49-f895-460c-964d-216e83ebd6e6 admin admin] PATH_INFO: `/v3/projects/5cab92b5736248ff9f541c77e47e4232/users/c7e35268186d4fb89cadb7e4edf40ea9/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:42.415395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecc3aa-ae65-4db9-a0b7-d37fe045e98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:42.417652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecc3aa-ae65-4db9-a0b7-d37fe045e98b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:42.421218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d9c49-f895-460c-964d-216e83ebd6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cab92b5736248ff9f541c77e47e4232, user_id=c7e35268186d4fb89cadb7e4edf40ea9, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:42.424253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d9c49-f895-460c-964d-216e83ebd6e6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:42.436552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 815/1636] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:42.438460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecc3aa-ae65-4db9-a0b7-d37fe045e98b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:42.460707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecc3aa-ae65-4db9-a0b7-d37fe045e98b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:42.465217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 822/1637] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:42 2022] PUT /identity/v3/projects/5cab92b5736248ff9f541c77e47e4232/users/c7e35268186d4fb89cadb7e4edf40ea9/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:42.466678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dcc68-9e4d-412b-8428-1bf66a86cd9a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:42.466999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dcc68-9e4d-412b-8428-1bf66a86cd9a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:42.467283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dcc68-9e4d-412b-8428-1bf66a86cd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:42.475865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:42.525346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cc1dcc68-9e4d-412b-8428-1bf66a86cd9a None None] MFA Rules not processed for user `38349aaa207c4703a18f512ad2f95196`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:42.527591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cc1dcc68-9e4d-412b-8428-1bf66a86cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:42.607651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67d712-fbce-402f-8c43-7d269e3fe6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:42.608947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67d712-fbce-402f-8c43-7d269e3fe6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:42.609311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67d712-fbce-402f-8c43-7d269e3fe6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:42.609706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67d712-fbce-402f-8c43-7d269e3fe6a5 admin admin] PATH_INFO: `/v3/projects/13d74e1fbdfa422b98a7ce15938b7326/users/5f0cec08ea1d425fa69ddce602785a6b/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:42.613261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67d712-fbce-402f-8c43-7d269e3fe6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d74e1fbdfa422b98a7ce15938b7326, user_id=5f0cec08ea1d425fa69ddce602785a6b, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:42.619009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67d712-fbce-402f-8c43-7d269e3fe6a5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:42.643329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 816/1638] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:42 2022] PUT /identity/v3/projects/13d74e1fbdfa422b98a7ce15938b7326/users/5f0cec08ea1d425fa69ddce602785a6b/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:42.643329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67d712-fbce-402f-8c43-7d269e3fe6a5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:42.699226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 823/1639] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:42.712162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f62e2-f3b2-4879-8ec9-0b1064572f26 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:42.713113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f62e2-f3b2-4879-8ec9-0b1064572f26 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:42.713113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f62e2-f3b2-4879-8ec9-0b1064572f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:42.776783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8f2f62e2-f3b2-4879-8ec9-0b1064572f26 None None] MFA Rules not processed for user `c7e35268186d4fb89cadb7e4edf40ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:42.778022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8f2f62e2-f3b2-4879-8ec9-0b1064572f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:42.807776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67d712-fbce-402f-8c43-7d269e3fe6a5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:42.812723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ea9bc-afdc-49c7-bb37-39217b445a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:42.813636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea9bc-afdc-49c7-bb37-39217b445a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:42.813919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea9bc-afdc-49c7-bb37-39217b445a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:42.814198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea9bc-afdc-49c7-bb37-39217b445a47 admin admin] PATH_INFO: `/v3/projects/74951432ebaf46e28c7c70315450e645/users/223b3d6ae5c24a8e9e1ba02ee0ebc410/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:42.828446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ea9bc-afdc-49c7-bb37-39217b445a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74951432ebaf46e28c7c70315450e645, user_id=223b3d6ae5c24a8e9e1ba02ee0ebc410, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:42.832188 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ea9bc-afdc-49c7-bb37-39217b445a47 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:42.858486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 817/1640] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:42 2022] PUT /identity/v3/projects/74951432ebaf46e28c7c70315450e645/users/223b3d6ae5c24a8e9e1ba02ee0ebc410/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:42.859869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f940f54-49bc-497b-9bd8-00bf1aa3ff1d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:42.860153 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f940f54-49bc-497b-9bd8-00bf1aa3ff1d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:42.860430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f940f54-49bc-497b-9bd8-00bf1aa3ff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:42.925022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4f940f54-49bc-497b-9bd8-00bf1aa3ff1d None None] MFA Rules not processed for user `5f0cec08ea1d425fa69ddce602785a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:42.925637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4f940f54-49bc-497b-9bd8-00bf1aa3ff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:42.940928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:42.997939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 824/1641] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:43.001255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f235b-fa7c-4826-a0f5-b09be652be67 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:43.003259 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f235b-fa7c-4826-a0f5-b09be652be67 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:43.003992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f235b-fa7c-4826-a0f5-b09be652be67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:43.056796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-cf0f235b-fa7c-4826-a0f5-b09be652be67 None None] MFA Rules not processed for user `38349aaa207c4703a18f512ad2f95196`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:43.061046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cf0f235b-fa7c-4826-a0f5-b09be652be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:43.104701 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 818/1642] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:42 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:43.106398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77008-2bf1-4e97-98f0-92938a2339dc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:43.106885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77008-2bf1-4e97-98f0-92938a2339dc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:43.107332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77008-2bf1-4e97-98f0-92938a2339dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:43.169192 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-fbf77008-2bf1-4e97-98f0-92938a2339dc None None] MFA Rules not processed for user `223b3d6ae5c24a8e9e1ba02ee0ebc410`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:43.170566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fbf77008-2bf1-4e97-98f0-92938a2339dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:43.275190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 825/1643] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:43.278107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f235b-fa7c-4826-a0f5-b09be652be67 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:43.348645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:43.349781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 819/1644] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:43.350483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf77008-2bf1-4e97-98f0-92938a2339dc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:43.459223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f235b-fa7c-4826-a0f5-b09be652be67 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:43.469163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80514dae-116e-4af7-a0b6-f70e35e6d9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:43.473881 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514dae-116e-4af7-a0b6-f70e35e6d9ad service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:43.474170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514dae-116e-4af7-a0b6-f70e35e6d9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:43.476494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514dae-116e-4af7-a0b6-f70e35e6d9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:43.479021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf77008-2bf1-4e97-98f0-92938a2339dc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:43.482833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f299f3-7784-434d-bcf2-ad4243c014c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:43.483490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f299f3-7784-434d-bcf2-ad4243c014c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:43.483773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f299f3-7784-434d-bcf2-ad4243c014c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:43.484048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f299f3-7784-434d-bcf2-ad4243c014c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:43.506571 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f299f3-7784-434d-bcf2-ad4243c014c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:43.510731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f299f3-7784-434d-bcf2-ad4243c014c4 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:43.531667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 820/1645] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:43 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:43.532310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f299f3-7784-434d-bcf2-ad4243c014c4 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:43.618565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:43.670471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f299f3-7784-434d-bcf2-ad4243c014c4 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:43.679123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234efcb-5457-4b85-83d7-b0e315d142ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:43.681458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234efcb-5457-4b85-83d7-b0e315d142ab service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:43.682048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234efcb-5457-4b85-83d7-b0e315d142ab service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:43.682478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234efcb-5457-4b85-83d7-b0e315d142ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:43.684877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80514dae-116e-4af7-a0b6-f70e35e6d9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:43.688256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80514dae-116e-4af7-a0b6-f70e35e6d9ad service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:43.695478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234efcb-5457-4b85-83d7-b0e315d142ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:43.697350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234efcb-5457-4b85-83d7-b0e315d142ab service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:43.717498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 826/1646] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:43.719691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94639582-fc99-49e4-91a7-3368cfc7906d None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:43.722368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94639582-fc99-49e4-91a7-3368cfc7906d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:43.722730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94639582-fc99-49e4-91a7-3368cfc7906d None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:43.722903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 821/1647] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:43.723976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234efcb-5457-4b85-83d7-b0e315d142ab service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:43.726993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 827/1648] 10.222.0.30 () {54 vars in 961 bytes} [Mon May 23 18:07:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:07:43.730779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61841d9-50c1-43cf-af26-396f3d88ed61 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:43.731177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61841d9-50c1-43cf-af26-396f3d88ed61 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:43.731572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61841d9-50c1-43cf-af26-396f3d88ed61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:43.748038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234efcb-5457-4b85-83d7-b0e315d142ab service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:43.753988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e61841d9-50c1-43cf-af26-396f3d88ed61 None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:43.755642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e61841d9-50c1-43cf-af26-396f3d88ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:43.760068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabca5f9-c3c1-485d-8842-81db0f4c7880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:43.761201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabca5f9-c3c1-485d-8842-81db0f4c7880 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:43.761828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabca5f9-c3c1-485d-8842-81db0f4c7880 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:43.762330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabca5f9-c3c1-485d-8842-81db0f4c7880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:43.796398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabca5f9-c3c1-485d-8842-81db0f4c7880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:43.800627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabca5f9-c3c1-485d-8842-81db0f4c7880 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:43.802621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 828/1649] 10.222.0.30 () {58 vars in 1058 bytes} [Mon May 23 18:07:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:43.809887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababc69-2a5f-4f88-83fb-f572b3081443 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:43.810245 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababc69-2a5f-4f88-83fb-f572b3081443 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:43.810588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababc69-2a5f-4f88-83fb-f572b3081443 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:43.812515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 829/1650] 10.222.0.30 () {54 vars in 912 bytes} [Mon May 23 18:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 18:07:43.818975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4183-8206-422f-b49a-211c1811495f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:43.819336 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4183-8206-422f-b49a-211c1811495f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:43.819685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4183-8206-422f-b49a-211c1811495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:43.842055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 822/1651] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:43.858046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-062d4183-8206-422f-b49a-211c1811495f None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:43.862256 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-062d4183-8206-422f-b49a-211c1811495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:43.889749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 830/1652] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:07:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:07:43.976109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabca5f9-c3c1-485d-8842-81db0f4c7880 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:43.996686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabca5f9-c3c1-485d-8842-81db0f4c7880 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:44.031532 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578667b2-9adf-45c1-ac15-6958e16ef55f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:44.032637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578667b2-9adf-45c1-ac15-6958e16ef55f service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:44.032637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578667b2-9adf-45c1-ac15-6958e16ef55f service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:44.032956 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578667b2-9adf-45c1-ac15-6958e16ef55f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:44.075311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4183-8206-422f-b49a-211c1811495f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:44.091096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4183-8206-422f-b49a-211c1811495f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:44.098046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431307-4be9-40be-a277-c8d3315ed75b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:44.099110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431307-4be9-40be-a277-c8d3315ed75b service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:44.099615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431307-4be9-40be-a277-c8d3315ed75b service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:44.100110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431307-4be9-40be-a277-c8d3315ed75b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:44.116421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc431307-4be9-40be-a277-c8d3315ed75b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:44.119507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc431307-4be9-40be-a277-c8d3315ed75b service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:44.137961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 831/1653] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:44.186545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578667b2-9adf-45c1-ac15-6958e16ef55f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:44.188467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578667b2-9adf-45c1-ac15-6958e16ef55f service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:44.202432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 823/1654] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:43 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:45.185022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431307-4be9-40be-a277-c8d3315ed75b service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:45.290150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36713e6-f4ee-4254-a612-5522b61e6eef None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:45.291210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36713e6-f4ee-4254-a612-5522b61e6eef None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:45.291665 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36713e6-f4ee-4254-a612-5522b61e6eef None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:45.294280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 824/1655] 10.222.0.30 () {54 vars in 912 bytes} [Mon May 23 18:07:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 18:07:45.301549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051be50-e00a-478c-be6a-6380db1ffee7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:45.302081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051be50-e00a-478c-be6a-6380db1ffee7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:45.302535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051be50-e00a-478c-be6a-6380db1ffee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:45.356119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8051be50-e00a-478c-be6a-6380db1ffee7 None None] MFA Rules not processed for user `a26055489c284bcf8f0d418e4afffe73`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:45.358057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8051be50-e00a-478c-be6a-6380db1ffee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:45.425881 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431307-4be9-40be-a277-c8d3315ed75b service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:45.443467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:45.444362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:45.444642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:45.444922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] PATH_INFO: `/v3/users/b6ea646b555a4f849c87c929118492b1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:45.452433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 825/1656] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:07:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:45.454970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ea646b555a4f849c87c929118492b1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:45.458048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:45.508841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051be50-e00a-478c-be6a-6380db1ffee7 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:45.524550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051be50-e00a-478c-be6a-6380db1ffee7 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:45.542064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df98d5-02ec-4665-9005-e32ebaaecd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:45.542778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df98d5-02ec-4665-9005-e32ebaaecd79 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:45.543121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df98d5-02ec-4665-9005-e32ebaaecd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:45.543417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df98d5-02ec-4665-9005-e32ebaaecd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:45.569916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df98d5-02ec-4665-9005-e32ebaaecd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:45.575149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df98d5-02ec-4665-9005-e32ebaaecd79 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:45.599226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ea646b555a4f849c87c929118492b1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:45.599408 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 826/1657] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:45.601355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:45.618242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ea646b555a4f849c87c929118492b1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:45.619262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ea646b555a4f849c87c929118492b1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:45.623875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ea646b555a4f849c87c929118492b1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:45.664384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ea646b555a4f849c87c929118492b1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:45.694931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 832/1658] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:07:45 2022] DELETE /identity/v3/users/b6ea646b555a4f849c87c929118492b1 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:45.701198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14324-fa29-47e1-8ace-37a0b6f9c0da None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:45.701763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14324-fa29-47e1-8ace-37a0b6f9c0da None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:45.702145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14324-fa29-47e1-8ace-37a0b6f9c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:45.751040 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9fe14324-fa29-47e1-8ace-37a0b6f9c0da None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:45.758765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9fe14324-fa29-47e1-8ace-37a0b6f9c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:45.840971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:46.039902 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 827/1659] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:07:46.055550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:46.057685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:46.256326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba56c81-1c8e-498d-bcb5-4b1c25df48a1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:46.264225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b2dee-c16b-44cd-ae1e-d3e31ea0d133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:46.266091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b2dee-c16b-44cd-ae1e-d3e31ea0d133 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:46.266382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b2dee-c16b-44cd-ae1e-d3e31ea0d133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:46.266661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b2dee-c16b-44cd-ae1e-d3e31ea0d133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:46.291517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b2dee-c16b-44cd-ae1e-d3e31ea0d133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:46.296068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b2dee-c16b-44cd-ae1e-d3e31ea0d133 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:46.331197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 833/1660] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:47.198306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad9069-ddd3-416e-893c-268bbbb9c47c None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:47.198920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad9069-ddd3-416e-893c-268bbbb9c47c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:47.199504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad9069-ddd3-416e-893c-268bbbb9c47c None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:47.201854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 828/1661] 10.222.0.30 () {54 vars in 960 bytes} [Mon May 23 18:07:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:07:47.209574 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ae3be-48ef-464b-a605-b0ef3c8e59c2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:47.209855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ae3be-48ef-464b-a605-b0ef3c8e59c2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:47.210131 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ae3be-48ef-464b-a605-b0ef3c8e59c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:47.247073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-369ae3be-48ef-464b-a605-b0ef3c8e59c2 None None] MFA Rules not processed for user `77e042a473204d358e3b0682bf1338d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:47.249282 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-369ae3be-48ef-464b-a605-b0ef3c8e59c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:47.436936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 834/1662] 10.222.0.30 () {58 vars in 1057 bytes} [Mon May 23 18:07:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:47.446943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad9069-ddd3-416e-893c-268bbbb9c47c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:47.474046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad9069-ddd3-416e-893c-268bbbb9c47c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:47.487570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8393f-9381-4cf5-83dc-2dd21d38f41c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:47.488505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8393f-9381-4cf5-83dc-2dd21d38f41c service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:47.488793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8393f-9381-4cf5-83dc-2dd21d38f41c service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:47.489069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8393f-9381-4cf5-83dc-2dd21d38f41c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:47.495322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0ee8393f-9381-4cf5-83dc-2dd21d38f41c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:47.544387 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8393f-9381-4cf5-83dc-2dd21d38f41c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:47.546013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8393f-9381-4cf5-83dc-2dd21d38f41c service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:47.575628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 829/1663] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:47.967619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ae3be-48ef-464b-a605-b0ef3c8e59c2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:47.969409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-369ae3be-48ef-464b-a605-b0ef3c8e59c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:48.013886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ae3be-48ef-464b-a605-b0ef3c8e59c2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:48.034864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:48.039289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:48.039689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:48.043048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] PATH_INFO: `/v3/users/a53e04638f5e4933b8843433230fc396` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:48.046483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53e04638f5e4933b8843433230fc396)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:48.048566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:48.216141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53e04638f5e4933b8843433230fc396'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:48.270446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53e04638f5e4933b8843433230fc396'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:48.277448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53e04638f5e4933b8843433230fc396'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:48.278477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53e04638f5e4933b8843433230fc396'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:48.290818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:48.323223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53e04638f5e4933b8843433230fc396'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:48.371380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 835/1664] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:07:47 2022] DELETE /identity/v3/users/a53e04638f5e4933b8843433230fc396 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:48.375913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29e939-a947-419f-98fd-54b0b5288684 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:48.376771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29e939-a947-419f-98fd-54b0b5288684 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:48.378121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29e939-a947-419f-98fd-54b0b5288684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:48.415428 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2d29e939-a947-419f-98fd-54b0b5288684 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:48.419399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2d29e939-a947-419f-98fd-54b0b5288684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:48.569807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 830/1665] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:48.632501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:48.634233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:48.840839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d44af7-d6c0-41db-8d30-b7ec579e4f6f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:48.846916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8df86-566f-4cfb-b5f2-5a9f06caa660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:48.846916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8df86-566f-4cfb-b5f2-5a9f06caa660 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:48.846916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8df86-566f-4cfb-b5f2-5a9f06caa660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:48.846916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8df86-566f-4cfb-b5f2-5a9f06caa660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:48.856957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8df86-566f-4cfb-b5f2-5a9f06caa660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:48.858567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8df86-566f-4cfb-b5f2-5a9f06caa660 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:48.874200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 836/1666] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:48.944971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29e939-a947-419f-98fd-54b0b5288684 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:48.946471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2d29e939-a947-419f-98fd-54b0b5288684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:48.972633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29e939-a947-419f-98fd-54b0b5288684 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:48.989880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:48.990872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:48.991158 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:48.991445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] PATH_INFO: `/v3/projects/3713cd2e1a9449028392f2120ad3314d` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:48.994380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3713cd2e1a9449028392f2120ad3314d)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:48.996402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:49.147552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3713cd2e1a9449028392f2120ad3314d', 'request_id': 'req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:49.171674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3713cd2e1a9449028392f2120ad3314d', 'request_id': 'req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:49.195534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3713cd2e1a9449028392f2120ad3314d', 'request_id': 'req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:49.222484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] The token cache is being invalidate because project 3713cd2e1a9449028392f2120ad3314d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:07:49.222840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:49.223850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:49.237069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8df86-566f-4cfb-b5f2-5a9f06caa660 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:49.243155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 831/1667] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:07:48 2022] DELETE /identity/v3/projects/3713cd2e1a9449028392f2120ad3314d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:49.250519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8df86-566f-4cfb-b5f2-5a9f06caa660 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:49.470920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:49.477548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:49.478582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:49.479076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] PATH_INFO: `/v3/users/223b3d6ae5c24a8e9e1ba02ee0ebc410` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:49.485288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=223b3d6ae5c24a8e9e1ba02ee0ebc410)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:49.494293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:49.613997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223b3d6ae5c24a8e9e1ba02ee0ebc410'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:49.634951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223b3d6ae5c24a8e9e1ba02ee0ebc410'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:49.636483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223b3d6ae5c24a8e9e1ba02ee0ebc410'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:49.637312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223b3d6ae5c24a8e9e1ba02ee0ebc410'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:49.667536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223b3d6ae5c24a8e9e1ba02ee0ebc410'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:49.687772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:49.701541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 837/1668] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:07:49 2022] DELETE /identity/v3/users/223b3d6ae5c24a8e9e1ba02ee0ebc410 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:50.088408 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:50.090890 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:50.117616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf6ee-c894-4dbb-8060-9b2009a7c0f1 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:50.244718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:50.329538 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:50.331495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:50.331830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:50.332333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] PATH_INFO: `/v3/projects/d8fd05bc2bd044538e2f547cbd339e96` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:50.348336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fd05bc2bd044538e2f547cbd339e96)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:50.350381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:50.445354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fd05bc2bd044538e2f547cbd339e96', 'request_id': 'req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:50.462229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fd05bc2bd044538e2f547cbd339e96', 'request_id': 'req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:50.481863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fd05bc2bd044538e2f547cbd339e96', 'request_id': 'req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:50.506946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] The token cache is being invalidate because project d8fd05bc2bd044538e2f547cbd339e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:07:50.507261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:50.514186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3f5867f6-e2fa-4ae4-9ffe-9b51fb5cc9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:50.520086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 832/1669] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:07:50 2022] DELETE /identity/v3/projects/d8fd05bc2bd044538e2f547cbd339e96 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:50.525279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:50.526828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:50.558478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fb4ca-5ef8-4f76-83f9-bf6838fd6e71 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:50.712816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:50.713725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:50.714014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:50.714299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] PATH_INFO: `/v3/users/c7e35268186d4fb89cadb7e4edf40ea9` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:50.715990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e35268186d4fb89cadb7e4edf40ea9)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:50.720341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:50.738690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9492a-4818-436e-b632-25a66c2a8f74 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:50.739011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9492a-4818-436e-b632-25a66c2a8f74 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:50.739294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9492a-4818-436e-b632-25a66c2a8f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:50.788170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2ec9492a-4818-436e-b632-25a66c2a8f74 None None] MFA Rules not processed for user `a57822c1558143d38ad17326a742c370`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:50.790006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2ec9492a-4818-436e-b632-25a66c2a8f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:50.822381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e35268186d4fb89cadb7e4edf40ea9'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:50.837240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e35268186d4fb89cadb7e4edf40ea9'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:50.838404 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e35268186d4fb89cadb7e4edf40ea9'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:50.841440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e35268186d4fb89cadb7e4edf40ea9'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:50.864297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-201de04b-fc40-4062-a876-0a6993221e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e35268186d4fb89cadb7e4edf40ea9'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:50.888500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 838/1670] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:07:50 2022] DELETE /identity/v3/users/c7e35268186d4fb89cadb7e4edf40ea9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:50.941563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 833/1671] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:50.944625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241d67-21ae-4c1c-bb42-14173c100cc4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:50.944917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241d67-21ae-4c1c-bb42-14173c100cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:50.945195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241d67-21ae-4c1c-bb42-14173c100cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:50.975777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9b241d67-21ae-4c1c-bb42-14173c100cc4 None None] MFA Rules not processed for user `a57822c1558143d38ad17326a742c370`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:50.977070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9b241d67-21ae-4c1c-bb42-14173c100cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:51.166550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 839/1672] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:51.174159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9492a-4818-436e-b632-25a66c2a8f74 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:51.175748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2ec9492a-4818-436e-b632-25a66c2a8f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:51.283281 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:51.313016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9492a-4818-436e-b632-25a66c2a8f74 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:51.346806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b241d67-21ae-4c1c-bb42-14173c100cc4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:51.349193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9b241d67-21ae-4c1c-bb42-14173c100cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:51.419007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:51.433329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89d1c-df88-4b0c-ba6d-1a3efcecf39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:51.433736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89d1c-df88-4b0c-ba6d-1a3efcecf39b service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:51.434028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89d1c-df88-4b0c-ba6d-1a3efcecf39b service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:51.434309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89d1c-df88-4b0c-ba6d-1a3efcecf39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:51.456608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de89d1c-df88-4b0c-ba6d-1a3efcecf39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:51.459519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de89d1c-df88-4b0c-ba6d-1a3efcecf39b service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:51.485859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 834/1673] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:51.496244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89d1c-df88-4b0c-ba6d-1a3efcecf39b service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:51.500569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3de89d1c-df88-4b0c-ba6d-1a3efcecf39b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:51.509297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b241d67-21ae-4c1c-bb42-14173c100cc4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:51.531841 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:51.532723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:51.534516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:51.534849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] PATH_INFO: `/v3/projects/74951432ebaf46e28c7c70315450e645` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:51.537415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=74951432ebaf46e28c7c70315450e645)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:51.538533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: WARNING py.warnings [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:07:51.538533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: warnings.warn(msg) May 23 18:07:51.538533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: May 23 18:07:51.541414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:51.559014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89d1c-df88-4b0c-ba6d-1a3efcecf39b service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:51.569412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:51.571136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:51.571427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:51.571759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] PATH_INFO: `/v3/projects/5cab92b5736248ff9f541c77e47e4232` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:51.579417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cab92b5736248ff9f541c77e47e4232)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:51.581681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:51.697853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cab92b5736248ff9f541c77e47e4232', 'request_id': 'req-ce148be0-b833-49c9-9509-acd3880a0919'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:51.717903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74951432ebaf46e28c7c70315450e645', 'request_id': 'req-21bb1848-6989-464e-9cdd-0a3c338a3e3c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:51.722548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cab92b5736248ff9f541c77e47e4232', 'request_id': 'req-ce148be0-b833-49c9-9509-acd3880a0919'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:51.739637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cab92b5736248ff9f541c77e47e4232', 'request_id': 'req-ce148be0-b833-49c9-9509-acd3880a0919'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:51.749902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74951432ebaf46e28c7c70315450e645', 'request_id': 'req-21bb1848-6989-464e-9cdd-0a3c338a3e3c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:51.761836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] The token cache is being invalidate because project 5cab92b5736248ff9f541c77e47e4232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:07:51.762215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:51.763220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ce148be0-b833-49c9-9509-acd3880a0919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:51.770821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 835/1674] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:07:51 2022] DELETE /identity/v3/projects/5cab92b5736248ff9f541c77e47e4232 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:51.772660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd7ed-5f5b-4f6d-9ebe-4033b067937c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:51.773212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd7ed-5f5b-4f6d-9ebe-4033b067937c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:51.773590 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd7ed-5f5b-4f6d-9ebe-4033b067937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:51.797052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74951432ebaf46e28c7c70315450e645', 'request_id': 'req-21bb1848-6989-464e-9cdd-0a3c338a3e3c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:51.826033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] The token cache is being invalidate because project 74951432ebaf46e28c7c70315450e645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:07:51.826569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:51.827536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-21bb1848-6989-464e-9cdd-0a3c338a3e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:51.829954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 840/1675] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:07:51 2022] DELETE /identity/v3/projects/74951432ebaf46e28c7c70315450e645 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:51.835133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbf72b-1306-4d3a-a5b0-6ec3caaafc7a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:51.835705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbf72b-1306-4d3a-a5b0-6ec3caaafc7a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:51.836693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbf72b-1306-4d3a-a5b0-6ec3caaafc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:51.853116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cc6bd7ed-5f5b-4f6d-9ebe-4033b067937c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:51.854479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cc6bd7ed-5f5b-4f6d-9ebe-4033b067937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:51.873323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2afbf72b-1306-4d3a-a5b0-6ec3caaafc7a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:51.875118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2afbf72b-1306-4d3a-a5b0-6ec3caaafc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:52.053412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 841/1676] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:52.054986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4706977-46b3-423b-b4a3-ffc779fd4513 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.055282 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4706977-46b3-423b-b4a3-ffc779fd4513 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.055568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4706977-46b3-423b-b4a3-ffc779fd4513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.062635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 836/1677] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:52.070372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0d396-54bd-46ed-96f4-8eb68acb126c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.070580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0d396-54bd-46ed-96f4-8eb68acb126c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.070873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0d396-54bd-46ed-96f4-8eb68acb126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.079481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:52.100589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d4706977-46b3-423b-b4a3-ffc779fd4513 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:52.102004 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d4706977-46b3-423b-b4a3-ffc779fd4513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:52.117368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1af0d396-54bd-46ed-96f4-8eb68acb126c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:52.120861 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1af0d396-54bd-46ed-96f4-8eb68acb126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:52.146925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 837/1678] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:52.150450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0d396-54bd-46ed-96f4-8eb68acb126c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.188797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0d396-54bd-46ed-96f4-8eb68acb126c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.192362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 842/1679] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:52.196710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4706977-46b3-423b-b4a3-ffc779fd4513 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.212460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4706977-46b3-423b-b4a3-ffc779fd4513 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.213620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5be62-3e0b-4d2e-83ee-f82d42f3559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.214309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5be62-3e0b-4d2e-83ee-f82d42f3559a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.214805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5be62-3e0b-4d2e-83ee-f82d42f3559a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.215172 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5be62-3e0b-4d2e-83ee-f82d42f3559a admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.216128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5be62-3e0b-4d2e-83ee-f82d42f3559a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:07:52.218668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c91f0-efad-43aa-a2ed-1f826cbbaa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.219109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5be62-3e0b-4d2e-83ee-f82d42f3559a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.220055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c91f0-efad-43aa-a2ed-1f826cbbaa0c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.221837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5be62-3e0b-4d2e-83ee-f82d42f3559a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.227084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c91f0-efad-43aa-a2ed-1f826cbbaa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.227430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c91f0-efad-43aa-a2ed-1f826cbbaa0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.228308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c91f0-efad-43aa-a2ed-1f826cbbaa0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:07:52.228686 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c91f0-efad-43aa-a2ed-1f826cbbaa0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.233239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c91f0-efad-43aa-a2ed-1f826cbbaa0c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.258803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 838/1680] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:07:52.259856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5be62-3e0b-4d2e-83ee-f82d42f3559a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.264122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 843/1681] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:07:52.268395 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c91f0-efad-43aa-a2ed-1f826cbbaa0c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.289002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5be62-3e0b-4d2e-83ee-f82d42f3559a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.297772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c91f0-efad-43aa-a2ed-1f826cbbaa0c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.302337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e69eb-ec7e-48c9-937f-9f672f8d291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.303994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e69eb-ec7e-48c9-937f-9f672f8d291b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.304286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e69eb-ec7e-48c9-937f-9f672f8d291b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.304564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e69eb-ec7e-48c9-937f-9f672f8d291b admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.305278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e69eb-ec7e-48c9-937f-9f672f8d291b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.308983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e69eb-ec7e-48c9-937f-9f672f8d291b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.313024 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690645a-0b0c-4057-84ad-2859684624e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.313704 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690645a-0b0c-4057-84ad-2859684624e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.314840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690645a-0b0c-4057-84ad-2859684624e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.315080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690645a-0b0c-4057-84ad-2859684624e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.315879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690645a-0b0c-4057-84ad-2859684624e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.320893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690645a-0b0c-4057-84ad-2859684624e7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.373831 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 839/1682] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:52 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:52.379671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e69eb-ec7e-48c9-937f-9f672f8d291b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.426534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 844/1683] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:52 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:52.432813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690645a-0b0c-4057-84ad-2859684624e7 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.464516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:52.479717 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e69eb-ec7e-48c9-937f-9f672f8d291b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.572593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690645a-0b0c-4057-84ad-2859684624e7 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.579260 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdabca-7797-4c01-82eb-54bcf7fb8ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.580801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdabca-7797-4c01-82eb-54bcf7fb8ffe admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.581323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdabca-7797-4c01-82eb-54bcf7fb8ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.581709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdabca-7797-4c01-82eb-54bcf7fb8ffe admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.582526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdabca-7797-4c01-82eb-54bcf7fb8ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.585443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdabca-7797-4c01-82eb-54bcf7fb8ffe admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.596636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8c25-922f-4d86-b525-ed0eebc73d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.603686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8c25-922f-4d86-b525-ed0eebc73d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.604503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8c25-922f-4d86-b525-ed0eebc73d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.604975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8c25-922f-4d86-b525-ed0eebc73d7c admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.606157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8c25-922f-4d86-b525-ed0eebc73d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.609042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8c25-922f-4d86-b525-ed0eebc73d7c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.621966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 845/1684] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:52 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:52.623412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdabca-7797-4c01-82eb-54bcf7fb8ffe admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.640576 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdabca-7797-4c01-82eb-54bcf7fb8ffe admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.652205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb26c9-abb8-4c19-b7d9-b1462f787c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.653251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb26c9-abb8-4c19-b7d9-b1462f787c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.653639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb26c9-abb8-4c19-b7d9-b1462f787c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.654037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb26c9-abb8-4c19-b7d9-b1462f787c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.654962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb26c9-abb8-4c19-b7d9-b1462f787c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.656818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb26c9-abb8-4c19-b7d9-b1462f787c96 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.658128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 840/1685] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:52 2022] POST /identity/v3/users => generated 294 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:52.663140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8c25-922f-4d86-b525-ed0eebc73d7c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.676935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 846/1686] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:52.677019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8c25-922f-4d86-b525-ed0eebc73d7c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.678062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb26c9-abb8-4c19-b7d9-b1462f787c96 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.687975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc12e6-fd70-4aa2-9488-151de6beed35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.688949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc12e6-fd70-4aa2-9488-151de6beed35 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.689960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc12e6-fd70-4aa2-9488-151de6beed35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.690806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc12e6-fd70-4aa2-9488-151de6beed35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.691796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc12e6-fd70-4aa2-9488-151de6beed35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.693463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc12e6-fd70-4aa2-9488-151de6beed35 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.708139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 841/1687] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:07:52.712299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc12e6-fd70-4aa2-9488-151de6beed35 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.715558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb26c9-abb8-4c19-b7d9-b1462f787c96 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.729355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc12e6-fd70-4aa2-9488-151de6beed35 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.729982 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e1f0b-86c7-421c-876f-1e0205f31ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.730843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e1f0b-86c7-421c-876f-1e0205f31ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.731531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e1f0b-86c7-421c-876f-1e0205f31ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.731883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e1f0b-86c7-421c-876f-1e0205f31ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.733757 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e1f0b-86c7-421c-876f-1e0205f31ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.743514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e1f0b-86c7-421c-876f-1e0205f31ca0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.744011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a084080-7c98-4e08-b243-6385d378701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.744800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084080-7c98-4e08-b243-6385d378701f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.745190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084080-7c98-4e08-b243-6385d378701f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.745569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084080-7c98-4e08-b243-6385d378701f admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.747624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a084080-7c98-4e08-b243-6385d378701f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.750311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a084080-7c98-4e08-b243-6385d378701f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.770065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 847/1688] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:52.771057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e1f0b-86c7-421c-876f-1e0205f31ca0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.778493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 842/1689] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:07:52.783949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a084080-7c98-4e08-b243-6385d378701f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:52.796977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e1f0b-86c7-421c-876f-1e0205f31ca0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.812004 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a084080-7c98-4e08-b243-6385d378701f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:52.814154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8ac89-fbe6-4326-a374-dddd658591fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.816660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8ac89-fbe6-4326-a374-dddd658591fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.817525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8ac89-fbe6-4326-a374-dddd658591fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.818218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8ac89-fbe6-4326-a374-dddd658591fc admin admin] PATH_INFO: `/v3/projects/78a7191c10ba4a36baa4fda3a6becdf7/users/72a1bcf986cf4dc9aab1c8c74471cff2/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.824778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483b5c6-61d4-4356-8ae7-0dbb2cd50cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:52.828088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483b5c6-61d4-4356-8ae7-0dbb2cd50cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.828837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483b5c6-61d4-4356-8ae7-0dbb2cd50cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.829217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483b5c6-61d4-4356-8ae7-0dbb2cd50cb8 admin admin] PATH_INFO: `/v3/projects/5a970d022be84305ae0a3cb3ab44c6d2/users/4ca356aaf98746e3bdba482cc863d947/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.886461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8ac89-fbe6-4326-a374-dddd658591fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a7191c10ba4a36baa4fda3a6becdf7, user_id=72a1bcf986cf4dc9aab1c8c74471cff2, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.894480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8ac89-fbe6-4326-a374-dddd658591fc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.909721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483b5c6-61d4-4356-8ae7-0dbb2cd50cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a970d022be84305ae0a3cb3ab44c6d2, user_id=4ca356aaf98746e3bdba482cc863d947, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:52.923680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483b5c6-61d4-4356-8ae7-0dbb2cd50cb8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:52.958569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 848/1690] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:52 2022] PUT /identity/v3/projects/78a7191c10ba4a36baa4fda3a6becdf7/users/72a1bcf986cf4dc9aab1c8c74471cff2/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:52.961132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59d41f-e9d0-47da-ae81-14b9f8124712 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.962012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59d41f-e9d0-47da-ae81-14b9f8124712 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.962657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59d41f-e9d0-47da-ae81-14b9f8124712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:52.971608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 843/1691] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:52 2022] PUT /identity/v3/projects/5a970d022be84305ae0a3cb3ab44c6d2/users/4ca356aaf98746e3bdba482cc863d947/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:52.982293 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85a7c6-00d8-4af1-bc21-287181749584 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:52.982741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85a7c6-00d8-4af1-bc21-287181749584 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:52.983123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85a7c6-00d8-4af1-bc21-287181749584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:53.027736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:53.054098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7b59d41f-e9d0-47da-ae81-14b9f8124712 None None] MFA Rules not processed for user `72a1bcf986cf4dc9aab1c8c74471cff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:53.061202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7b59d41f-e9d0-47da-ae81-14b9f8124712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:53.070456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-2e85a7c6-00d8-4af1-bc21-287181749584 None None] MFA Rules not processed for user `4ca356aaf98746e3bdba482cc863d947`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:53.076337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2e85a7c6-00d8-4af1-bc21-287181749584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:53.310260 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 849/1692] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:53.318618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 844/1693] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:07:53.319958 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59d41f-e9d0-47da-ae81-14b9f8124712 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:53.324845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85a7c6-00d8-4af1-bc21-287181749584 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:53.503154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:53.548530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85a7c6-00d8-4af1-bc21-287181749584 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:53.556036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59d41f-e9d0-47da-ae81-14b9f8124712 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:53.566065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0e86e-8052-4685-95e3-7a18f3c9213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:53.566674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e86e-8052-4685-95e3-7a18f3c9213f admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:53.567312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e86e-8052-4685-95e3-7a18f3c9213f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:53.567573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e86e-8052-4685-95e3-7a18f3c9213f admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:53.568269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0e86e-8052-4685-95e3-7a18f3c9213f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:53.570177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0e86e-8052-4685-95e3-7a18f3c9213f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:53.570991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea8789-cb2d-43cf-b64b-e89d9bf3105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:53.571840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea8789-cb2d-43cf-b64b-e89d9bf3105e admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:53.572129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea8789-cb2d-43cf-b64b-e89d9bf3105e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:53.572406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea8789-cb2d-43cf-b64b-e89d9bf3105e admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:53.573104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea8789-cb2d-43cf-b64b-e89d9bf3105e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:53.577446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea8789-cb2d-43cf-b64b-e89d9bf3105e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:53.681441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 845/1694] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:53 2022] POST /identity/v3/projects => generated 385 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:53.681441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0e86e-8052-4685-95e3-7a18f3c9213f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:53.682017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 850/1695] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:53 2022] POST /identity/v3/projects => generated 377 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:53.682643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea8789-cb2d-43cf-b64b-e89d9bf3105e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:53.837607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0e86e-8052-4685-95e3-7a18f3c9213f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:53.840745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea8789-cb2d-43cf-b64b-e89d9bf3105e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:53.846723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38f55-cec3-42e7-a945-c186d29056ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:53.847449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38f55-cec3-42e7-a945-c186d29056ca admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:53.847620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadc976-fac9-45b1-b74e-acb85f56082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:53.847724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38f55-cec3-42e7-a945-c186d29056ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:53.848003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38f55-cec3-42e7-a945-c186d29056ca admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:53.848267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadc976-fac9-45b1-b74e-acb85f56082c admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:53.848555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadc976-fac9-45b1-b74e-acb85f56082c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:53.848835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadc976-fac9-45b1-b74e-acb85f56082c admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:53.849001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab38f55-cec3-42e7-a945-c186d29056ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:53.849534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadc976-fac9-45b1-b74e-acb85f56082c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:53.853463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab38f55-cec3-42e7-a945-c186d29056ca admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:53.859663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadc976-fac9-45b1-b74e-acb85f56082c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:53.889739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 851/1696] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:53 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:53.891329 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f338-697c-42a4-9dcf-aa8145ad1184 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:53.891830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f338-697c-42a4-9dcf-aa8145ad1184 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:53.892112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f338-697c-42a4-9dcf-aa8145ad1184 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:53.894487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 852/1697] 10.222.0.30 () {54 vars in 912 bytes} [Mon May 23 18:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:07:53.895779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1541-f9ea-4e3e-a819-baa68c5acc79 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:53.896254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1541-f9ea-4e3e-a819-baa68c5acc79 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:53.896585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1541-f9ea-4e3e-a819-baa68c5acc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:53.898984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 846/1698] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:53 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:53.903315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38f55-cec3-42e7-a945-c186d29056ca admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:53.935635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38f55-cec3-42e7-a945-c186d29056ca admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:53.940778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-029e1541-f9ea-4e3e-a819-baa68c5acc79 None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:53.945984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712bbb2-a4b5-40fc-8cc8-24db1635552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:53.946551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-029e1541-f9ea-4e3e-a819-baa68c5acc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:53.947989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bbb2-a4b5-40fc-8cc8-24db1635552c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:53.948279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bbb2-a4b5-40fc-8cc8-24db1635552c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:53.948556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712bbb2-a4b5-40fc-8cc8-24db1635552c admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:53.950924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712bbb2-a4b5-40fc-8cc8-24db1635552c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:53.953313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712bbb2-a4b5-40fc-8cc8-24db1635552c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:53.984757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 847/1699] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:53.984757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712bbb2-a4b5-40fc-8cc8-24db1635552c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:54.003136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:54.012623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712bbb2-a4b5-40fc-8cc8-24db1635552c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:54.027235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e6c42-631e-4a8e-930a-23d1a614a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:54.028868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e6c42-631e-4a8e-930a-23d1a614a1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:54.029569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e6c42-631e-4a8e-930a-23d1a614a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:54.029928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e6c42-631e-4a8e-930a-23d1a614a1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:54.032414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e6c42-631e-4a8e-930a-23d1a614a1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:54.034111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e6c42-631e-4a8e-930a-23d1a614a1ea admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:54.066475 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 848/1700] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:54.067971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a80eb7-38f9-4c6b-93e8-70ef41aae33a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:54.068273 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a80eb7-38f9-4c6b-93e8-70ef41aae33a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:54.068554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a80eb7-38f9-4c6b-93e8-70ef41aae33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:54.103722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 853/1701] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:07:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:54.104847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e1541-f9ea-4e3e-a819-baa68c5acc79 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:54.148643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-53a80eb7-38f9-4c6b-93e8-70ef41aae33a None None] MFA Rules not processed for user `a26055489c284bcf8f0d418e4afffe73`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:54.151772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-53a80eb7-38f9-4c6b-93e8-70ef41aae33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:54.175083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e1541-f9ea-4e3e-a819-baa68c5acc79 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:54.186675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd60c9-0b91-48f7-b1eb-8cd9875f4f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:54.187616 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd60c9-0b91-48f7-b1eb-8cd9875f4f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:54.187911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd60c9-0b91-48f7-b1eb-8cd9875f4f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:54.188179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd60c9-0b91-48f7-b1eb-8cd9875f4f09 admin admin] PATH_INFO: `/v3/projects/351cc41e96864775b9f156b0619a4fa3/users/0fd870b27d5242f4b1471a2cf44b8aec/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:54.226007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd60c9-0b91-48f7-b1eb-8cd9875f4f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351cc41e96864775b9f156b0619a4fa3, user_id=0fd870b27d5242f4b1471a2cf44b8aec, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:54.239982 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd60c9-0b91-48f7-b1eb-8cd9875f4f09 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:54.274525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 854/1702] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:54 2022] PUT /identity/v3/projects/351cc41e96864775b9f156b0619a4fa3/users/0fd870b27d5242f4b1471a2cf44b8aec/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:54.282048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd60c9-0b91-48f7-b1eb-8cd9875f4f09 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:54.329842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 849/1703] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:07:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:54.335016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a80eb7-38f9-4c6b-93e8-70ef41aae33a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:54.359883 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a80eb7-38f9-4c6b-93e8-70ef41aae33a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:54.401482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:54.499490 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd60c9-0b91-48f7-b1eb-8cd9875f4f09 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:54.508477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c61a8-5dc6-4c66-b870-2912289095a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:54.509441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c61a8-5dc6-4c66-b870-2912289095a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:54.509893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c61a8-5dc6-4c66-b870-2912289095a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:54.510338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c61a8-5dc6-4c66-b870-2912289095a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:54.511998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c61a8-5dc6-4c66-b870-2912289095a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:54.513815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c61a8-5dc6-4c66-b870-2912289095a6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:54.557597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 855/1704] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:54.557597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c61a8-5dc6-4c66-b870-2912289095a6 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:54.568620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c51c61a8-5dc6-4c66-b870-2912289095a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:54.584630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62c9ea-85a4-42b8-ae39-48d68074af45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:54.585469 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62c9ea-85a4-42b8-ae39-48d68074af45 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:54.585618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62c9ea-85a4-42b8-ae39-48d68074af45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:54.585891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62c9ea-85a4-42b8-ae39-48d68074af45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:54.586637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62c9ea-85a4-42b8-ae39-48d68074af45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:54.594973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62c9ea-85a4-42b8-ae39-48d68074af45 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:54.635325 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 850/1705] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:54.636425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62c9ea-85a4-42b8-ae39-48d68074af45 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:54.645529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7d62c9ea-85a4-42b8-ae39-48d68074af45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:54.675434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c61a8-5dc6-4c66-b870-2912289095a6 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:54.684233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c00c-480a-454e-946a-cd79bd54213c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:54.685172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c00c-480a-454e-946a-cd79bd54213c service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:54.685630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c00c-480a-454e-946a-cd79bd54213c service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:54.686055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c00c-480a-454e-946a-cd79bd54213c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:54.702281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c00c-480a-454e-946a-cd79bd54213c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:54.703640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c00c-480a-454e-946a-cd79bd54213c service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:54.716065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 856/1706] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:54.717002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c00c-480a-454e-946a-cd79bd54213c service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:54.732504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c00c-480a-454e-946a-cd79bd54213c service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:54.742650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86c017-f6bd-448f-834f-3edb5b46e2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:54.743614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86c017-f6bd-448f-834f-3edb5b46e2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:54.743899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86c017-f6bd-448f-834f-3edb5b46e2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:54.744175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86c017-f6bd-448f-834f-3edb5b46e2b4 admin admin] PATH_INFO: `/v3/projects/5aece902be57480b9aef7d164770ed84/users/34d705d260d54fe59f39e8c9c327bfcf/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:54.767383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86c017-f6bd-448f-834f-3edb5b46e2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aece902be57480b9aef7d164770ed84, user_id=34d705d260d54fe59f39e8c9c327bfcf, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:54.772820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86c017-f6bd-448f-834f-3edb5b46e2b4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:54.824605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 857/1707] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:54 2022] PUT /identity/v3/projects/5aece902be57480b9aef7d164770ed84/users/34d705d260d54fe59f39e8c9c327bfcf/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:54.838594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86c017-f6bd-448f-834f-3edb5b46e2b4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:54.867443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62c9ea-85a4-42b8-ae39-48d68074af45 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:54.958872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:54.973589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86c017-f6bd-448f-834f-3edb5b46e2b4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:54.979752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff0663-ac59-48c5-9d48-9107dacfab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:54.982550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0663-ac59-48c5-9d48-9107dacfab5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:54.987375 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0663-ac59-48c5-9d48-9107dacfab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:54.987932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0663-ac59-48c5-9d48-9107dacfab5d admin admin] PATH_INFO: `/v3/projects/351cc41e96864775b9f156b0619a4fa3/users/0fd870b27d5242f4b1471a2cf44b8aec/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:55.002117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff0663-ac59-48c5-9d48-9107dacfab5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=351cc41e96864775b9f156b0619a4fa3, user_id=0fd870b27d5242f4b1471a2cf44b8aec, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:55.002878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea31c0-333f-4a7c-9876-4273e77ad953 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:55.006268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff0663-ac59-48c5-9d48-9107dacfab5d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:55.008619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea31c0-333f-4a7c-9876-4273e77ad953 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:55.009725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea31c0-333f-4a7c-9876-4273e77ad953 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:55.010097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea31c0-333f-4a7c-9876-4273e77ad953 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:55.020279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 858/1708] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:54 2022] PUT /identity/v3/projects/351cc41e96864775b9f156b0619a4fa3/users/0fd870b27d5242f4b1471a2cf44b8aec/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:55.044335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b5cf0-5c9e-4c51-8876-25cd865a92f8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:55.049688 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b5cf0-5c9e-4c51-8876-25cd865a92f8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:55.050510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b5cf0-5c9e-4c51-8876-25cd865a92f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:55.116761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-443b5cf0-5c9e-4c51-8876-25cd865a92f8 None None] MFA Rules not processed for user `34d705d260d54fe59f39e8c9c327bfcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:55.118492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-443b5cf0-5c9e-4c51-8876-25cd865a92f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:55.161466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea31c0-333f-4a7c-9876-4273e77ad953 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:55.166437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea31c0-333f-4a7c-9876-4273e77ad953 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:55.193957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:55.197179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 851/1709] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:07:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:07:55.200630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ddd0-822b-42cb-9279-df18894230dd None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:55.200927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ddd0-822b-42cb-9279-df18894230dd None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:55.201210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ddd0-822b-42cb-9279-df18894230dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:55.248197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 859/1710] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:55.256689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a281d-77f4-49be-a7c5-972b5caa952d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:55.257162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a281d-77f4-49be-a7c5-972b5caa952d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:55.257445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a281d-77f4-49be-a7c5-972b5caa952d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:55.305676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5a3a281d-77f4-49be-a7c5-972b5caa952d None None] MFA Rules not processed for user `32e9879d092b4c819f1f5607f42cc364`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:55.307612 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5a3a281d-77f4-49be-a7c5-972b5caa952d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:55.320700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cd40ddd0-822b-42cb-9279-df18894230dd None None] MFA Rules not processed for user `0fd870b27d5242f4b1471a2cf44b8aec`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:55.323418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cd40ddd0-822b-42cb-9279-df18894230dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:55.668772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 852/1711] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:55.674829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40ddd0-822b-42cb-9279-df18894230dd None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:55.707839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 860/1712] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:55.711045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a281d-77f4-49be-a7c5-972b5caa952d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:55.712601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5a3a281d-77f4-49be-a7c5-972b5caa952d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:55.897358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a281d-77f4-49be-a7c5-972b5caa952d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:55.906881 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1573f-c391-4d2c-b557-7e89c106f82d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:55.909682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1573f-c391-4d2c-b557-7e89c106f82d service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:55.910104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1573f-c391-4d2c-b557-7e89c106f82d service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:55.911473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1573f-c391-4d2c-b557-7e89c106f82d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:55.946340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1573f-c391-4d2c-b557-7e89c106f82d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:55.956713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40ddd0-822b-42cb-9279-df18894230dd None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:55.957563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1573f-c391-4d2c-b557-7e89c106f82d service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:55.979163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328bbd5-67e4-44af-902c-f7af0c01c23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:55.984645 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328bbd5-67e4-44af-902c-f7af0c01c23c admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:55.985200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328bbd5-67e4-44af-902c-f7af0c01c23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:55.987052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328bbd5-67e4-44af-902c-f7af0c01c23c admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:55.987943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328bbd5-67e4-44af-902c-f7af0c01c23c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:55.994529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328bbd5-67e4-44af-902c-f7af0c01c23c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:55.996827 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 861/1713] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:56.012161 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1573f-c391-4d2c-b557-7e89c106f82d service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:56.015932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-13f1573f-c391-4d2c-b557-7e89c106f82d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:56.034861 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:56.065349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 853/1714] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:07:55 2022] POST /identity/v3/projects => generated 377 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:07:56.067076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328bbd5-67e4-44af-902c-f7af0c01c23c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:56.194314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328bbd5-67e4-44af-902c-f7af0c01c23c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:56.201899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c4bb3-6de2-4474-8edf-14165562a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:56.202817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c4bb3-6de2-4474-8edf-14165562a069 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:56.203114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c4bb3-6de2-4474-8edf-14165562a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:56.203393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c4bb3-6de2-4474-8edf-14165562a069 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:56.204092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c4bb3-6de2-4474-8edf-14165562a069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:56.206664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c4bb3-6de2-4474-8edf-14165562a069 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:56.257875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 854/1715] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:07:56 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:07:56.264990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c4bb3-6de2-4474-8edf-14165562a069 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:56.308079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c4bb3-6de2-4474-8edf-14165562a069 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:56.319018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1573f-c391-4d2c-b557-7e89c106f82d service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:56.325468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:56.327586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:56.329669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:56.330031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] PATH_INFO: `/v3/users/4ca356aaf98746e3bdba482cc863d947` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:56.332590 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca356aaf98746e3bdba482cc863d947)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:56.336570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: WARNING py.warnings [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 18:07:56.336570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: warnings.warn(msg) May 23 18:07:56.336570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: May 23 18:07:56.340531 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:56.341302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:56.573313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca356aaf98746e3bdba482cc863d947'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:56.574243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca356aaf98746e3bdba482cc863d947'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:56.601467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca356aaf98746e3bdba482cc863d947'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:56.605622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9725dff-f386-4b51-b74f-471d5e883ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:56.606108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca356aaf98746e3bdba482cc863d947'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:56.608543 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9725dff-f386-4b51-b74f-471d5e883ce1 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:56.623387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9725dff-f386-4b51-b74f-471d5e883ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:56.624167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9725dff-f386-4b51-b74f-471d5e883ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:56.643997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e9725dff-f386-4b51-b74f-471d5e883ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:56.649187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca356aaf98746e3bdba482cc863d947'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:56.677739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 855/1716] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:07:56 2022] DELETE /identity/v3/users/4ca356aaf98746e3bdba482cc863d947 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:56.684862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:56.689875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:56.864349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:56.877553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7131497-c25b-4bf7-9725-4df7ddfffb09 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:56.900746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a8453-5191-4789-8105-de999c19736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:56.905275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a8453-5191-4789-8105-de999c19736a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:56.905629 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a8453-5191-4789-8105-de999c19736a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:56.905923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a8453-5191-4789-8105-de999c19736a admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:56.906737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a8453-5191-4789-8105-de999c19736a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:56.918346 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a8453-5191-4789-8105-de999c19736a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:56.960311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 856/1717] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:56.979910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4aea8-3ad8-4855-82f9-7085adf76ef0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:56.980848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4aea8-3ad8-4855-82f9-7085adf76ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:56.982252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4aea8-3ad8-4855-82f9-7085adf76ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:56.991770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9725dff-f386-4b51-b74f-471d5e883ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:56.996738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9725dff-f386-4b51-b74f-471d5e883ce1 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:57.035260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a7d4aea8-3ad8-4855-82f9-7085adf76ef0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:57.038733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a7d4aea8-3ad8-4855-82f9-7085adf76ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:57.044341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 862/1718] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 1033 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:57.046405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2a68-1b69-415a-be61-8cf3ee8aeb0e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:57.046732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2a68-1b69-415a-be61-8cf3ee8aeb0e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:57.048850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2a68-1b69-415a-be61-8cf3ee8aeb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:57.055499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 857/1719] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:57.056659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4aea8-3ad8-4855-82f9-7085adf76ef0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:57.097458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4aea8-3ad8-4855-82f9-7085adf76ef0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:57.102857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5f854-2b97-44d4-aa3f-848aa397bf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:57.104302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bbba2a68-1b69-415a-be61-8cf3ee8aeb0e None None] MFA Rules not processed for user `a26055489c284bcf8f0d418e4afffe73`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:57.104436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f854-2b97-44d4-aa3f-848aa397bf1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:57.105200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f854-2b97-44d4-aa3f-848aa397bf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:57.105627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f854-2b97-44d4-aa3f-848aa397bf1a admin admin] PATH_INFO: `/v3/projects/f09d9a2ebae94946a5f6652a68b8e66b/users/4c7000eda8064dd68eab43e307b0c819/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:57.110212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bbba2a68-1b69-415a-be61-8cf3ee8aeb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:57.136746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5f854-2b97-44d4-aa3f-848aa397bf1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09d9a2ebae94946a5f6652a68b8e66b, user_id=4c7000eda8064dd68eab43e307b0c819, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:57.141512 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5f854-2b97-44d4-aa3f-848aa397bf1a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:57.195239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 858/1720] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:57 2022] PUT /identity/v3/projects/f09d9a2ebae94946a5f6652a68b8e66b/users/4c7000eda8064dd68eab43e307b0c819/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:57.196382 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5f854-2b97-44d4-aa3f-848aa397bf1a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:57.205900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c2a5f854-2b97-44d4-aa3f-848aa397bf1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:57.321175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 863/1721] 10.222.0.41 () {58 vars in 1015 bytes} [Mon May 23 18:07:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:57.324680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2a68-1b69-415a-be61-8cf3ee8aeb0e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:57.359341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2a68-1b69-415a-be61-8cf3ee8aeb0e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:57.480628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:57.516809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfdf2a-080d-4315-8ca0-d03447559f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:57.518169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfdf2a-080d-4315-8ca0-d03447559f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:57.518560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfdf2a-080d-4315-8ca0-d03447559f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:57.518867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfdf2a-080d-4315-8ca0-d03447559f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:57.519669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfdf2a-080d-4315-8ca0-d03447559f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:57.539187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfdf2a-080d-4315-8ca0-d03447559f19 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:57.550974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5f854-2b97-44d4-aa3f-848aa397bf1a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:57.569644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807405c6-cd59-4ca9-a052-7f5787067cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:57.574262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807405c6-cd59-4ca9-a052-7f5787067cfe service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:57.574603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807405c6-cd59-4ca9-a052-7f5787067cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:57.580661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807405c6-cd59-4ca9-a052-7f5787067cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:57.588233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 864/1722] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:07:57.588233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfdf2a-080d-4315-8ca0-d03447559f19 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:57.623900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfdf2a-080d-4315-8ca0-d03447559f19 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:57.634824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807405c6-cd59-4ca9-a052-7f5787067cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:57.635030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaae5b-867a-45a7-b03f-7c7feac9c0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:57.635030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaae5b-867a-45a7-b03f-7c7feac9c0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:57.635030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaae5b-867a-45a7-b03f-7c7feac9c0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:57.635030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaae5b-867a-45a7-b03f-7c7feac9c0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:57.643898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807405c6-cd59-4ca9-a052-7f5787067cfe service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:57.656743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaae5b-867a-45a7-b03f-7c7feac9c0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:57.669185 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaae5b-867a-45a7-b03f-7c7feac9c0f4 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:57.694009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 859/1723] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:57.698269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 865/1724] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:57.701980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807405c6-cd59-4ca9-a052-7f5787067cfe service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:57.702801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1362cf5-61e5-4e12-b5aa-08f2597c5c61 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:57.703100 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1362cf5-61e5-4e12-b5aa-08f2597c5c61 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:57.705228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1362cf5-61e5-4e12-b5aa-08f2597c5c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:57.750135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807405c6-cd59-4ca9-a052-7f5787067cfe service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:57.755478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d1362cf5-61e5-4e12-b5aa-08f2597c5c61 None None] MFA Rules not processed for user `a57822c1558143d38ad17326a742c370`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:57.760444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d1362cf5-61e5-4e12-b5aa-08f2597c5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:57.780249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36622ead-9c03-49d5-8d46-0d9038d2d689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:57.781962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36622ead-9c03-49d5-8d46-0d9038d2d689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:57.782214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36622ead-9c03-49d5-8d46-0d9038d2d689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:57.782499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36622ead-9c03-49d5-8d46-0d9038d2d689 admin admin] PATH_INFO: `/v3/projects/f09d9a2ebae94946a5f6652a68b8e66b/users/4c7000eda8064dd68eab43e307b0c819/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:57.795515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36622ead-9c03-49d5-8d46-0d9038d2d689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09d9a2ebae94946a5f6652a68b8e66b, user_id=4c7000eda8064dd68eab43e307b0c819, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:57.812518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36622ead-9c03-49d5-8d46-0d9038d2d689 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:57.918432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 860/1725] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:07:57 2022] PUT /identity/v3/projects/f09d9a2ebae94946a5f6652a68b8e66b/users/4c7000eda8064dd68eab43e307b0c819/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:57.932322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6308a-14d5-436e-954e-ec6a69502440 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:57.932621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6308a-14d5-436e-954e-ec6a69502440 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:57.932905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6308a-14d5-436e-954e-ec6a69502440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:58.035424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 866/1726] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:58.069718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1362cf5-61e5-4e12-b5aa-08f2597c5c61 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:58.072156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d1362cf5-61e5-4e12-b5aa-08f2597c5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:58.103514 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cbe6308a-14d5-436e-954e-ec6a69502440 None None] MFA Rules not processed for user `4c7000eda8064dd68eab43e307b0c819`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:58.112049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cbe6308a-14d5-436e-954e-ec6a69502440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:58.148300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1362cf5-61e5-4e12-b5aa-08f2597c5c61 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:58.493476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 861/1727] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:07:58.509868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6308a-14d5-436e-954e-ec6a69502440 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:58.511446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cbe6308a-14d5-436e-954e-ec6a69502440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:58.583600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:58.584661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:58.584949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:58.597310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] PATH_INFO: `/v3/users/7e947a9f2fe24dae963621b64b9a3968` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:58.607125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e947a9f2fe24dae963621b64b9a3968)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:58.610005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:58.610207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:58.649079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6308a-14d5-436e-954e-ec6a69502440 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:58.659300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae239f87-b176-41c7-ac6b-3729c226b3d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:58.660393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae239f87-b176-41c7-ac6b-3729c226b3d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:58.660818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae239f87-b176-41c7-ac6b-3729c226b3d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:58.665672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae239f87-b176-41c7-ac6b-3729c226b3d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:58.686691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae239f87-b176-41c7-ac6b-3729c226b3d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:58.688377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae239f87-b176-41c7-ac6b-3729c226b3d5 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:58.718950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 862/1728] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:58.821669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e947a9f2fe24dae963621b64b9a3968'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:58.851961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae239f87-b176-41c7-ac6b-3729c226b3d5 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:58.853838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ae239f87-b176-41c7-ac6b-3729c226b3d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:58.868722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e947a9f2fe24dae963621b64b9a3968'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:58.871613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e947a9f2fe24dae963621b64b9a3968'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:58.873632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e947a9f2fe24dae963621b64b9a3968'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:58.878812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae239f87-b176-41c7-ac6b-3729c226b3d5 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:58.897129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d65f4-801e-4076-b085-7ff481276150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:58.900278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d65f4-801e-4076-b085-7ff481276150 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:58.904122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d65f4-801e-4076-b085-7ff481276150 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:58.904439 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d65f4-801e-4076-b085-7ff481276150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:58.914474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e71d65f4-801e-4076-b085-7ff481276150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:58.929852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8dff6dc8-46eb-4df0-a69c-e19954136503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e947a9f2fe24dae963621b64b9a3968'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:07:58.968548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 867/1729] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:07:58 2022] DELETE /identity/v3/users/7e947a9f2fe24dae963621b64b9a3968 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:07:58.973878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d10e7-e656-429f-b732-865cec658d9d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:58.974316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d10e7-e656-429f-b732-865cec658d9d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:58.974614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d10e7-e656-429f-b732-865cec658d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:58.996221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:07:59.036534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e12d10e7-e656-429f-b732-865cec658d9d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:07:59.037910 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e12d10e7-e656-429f-b732-865cec658d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:59.103201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d65f4-801e-4076-b085-7ff481276150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:59.105206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d65f4-801e-4076-b085-7ff481276150 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:07:59.150068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 863/1730] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:07:59.272455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 868/1731] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:07:59.377969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d65f4-801e-4076-b085-7ff481276150 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:07:59.379593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e71d65f4-801e-4076-b085-7ff481276150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:07:59.651314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d65f4-801e-4076-b085-7ff481276150 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:07:59.888029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61fad5-a7aa-4385-82ac-e91f04b67e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:07:59.889033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61fad5-a7aa-4385-82ac-e91f04b67e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:07:59.889033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61fad5-a7aa-4385-82ac-e91f04b67e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:07:59.889373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61fad5-a7aa-4385-82ac-e91f04b67e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:07:59.927079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61fad5-a7aa-4385-82ac-e91f04b67e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:07:59.931264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61fad5-a7aa-4385-82ac-e91f04b67e15 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:00.001285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 864/1732] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:02.683123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aacd33-ae13-40be-8be7-2680de816cfc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:02.684333 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aacd33-ae13-40be-8be7-2680de816cfc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:02.684943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aacd33-ae13-40be-8be7-2680de816cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:02.802257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61fad5-a7aa-4385-82ac-e91f04b67e15 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:02.804234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4c61fad5-a7aa-4385-82ac-e91f04b67e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:02.859112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61fad5-a7aa-4385-82ac-e91f04b67e15 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:02.872793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:02.875415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-56aacd33-ae13-40be-8be7-2680de816cfc None None] MFA Rules not processed for user `8d08ba344a9349d99de16520d3ce5150`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:02.875920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:02.878264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:02.879453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] PATH_INFO: `/v3/projects/67663c58bce243c7a6141d5d6da3322c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:02.880199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-56aacd33-ae13-40be-8be7-2680de816cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:02.883888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67663c58bce243c7a6141d5d6da3322c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:02.887186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:02.990231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:03.038550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67663c58bce243c7a6141d5d6da3322c', 'request_id': 'req-16efe22c-2484-4a70-aa2b-d525b5721203'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:03.057477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67663c58bce243c7a6141d5d6da3322c', 'request_id': 'req-16efe22c-2484-4a70-aa2b-d525b5721203'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:03.075774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67663c58bce243c7a6141d5d6da3322c', 'request_id': 'req-16efe22c-2484-4a70-aa2b-d525b5721203'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:03.106086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] The token cache is being invalidate because project 67663c58bce243c7a6141d5d6da3322c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:03.106431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:03.110249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16efe22c-2484-4a70-aa2b-d525b5721203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:03.117815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 865/1733] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:02 2022] DELETE /identity/v3/projects/67663c58bce243c7a6141d5d6da3322c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:03.122685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f228dec-d7b2-49b5-a120-97fab38917f7 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:03.123520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f228dec-d7b2-49b5-a120-97fab38917f7 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:03.124416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f228dec-d7b2-49b5-a120-97fab38917f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:03.157354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 869/1734] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:03.174547 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aacd33-ae13-40be-8be7-2680de816cfc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:03.176486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-56aacd33-ae13-40be-8be7-2680de816cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:03.210414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4f228dec-d7b2-49b5-a120-97fab38917f7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:03.220452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4f228dec-d7b2-49b5-a120-97fab38917f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:03.415456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aacd33-ae13-40be-8be7-2680de816cfc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:03.449318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 866/1735] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:08:03.452913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5fe4-bbe2-4abd-85e3-3d110074acc0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:03.453273 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5fe4-bbe2-4abd-85e3-3d110074acc0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:03.453626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5fe4-bbe2-4abd-85e3-3d110074acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:03.477106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-180e5fe4-bbe2-4abd-85e3-3d110074acc0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:03.478521 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-180e5fe4-bbe2-4abd-85e3-3d110074acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:03.492443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 867/1736] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:03.496961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e5fe4-bbe2-4abd-85e3-3d110074acc0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:03.512660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:03.515412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e5fe4-bbe2-4abd-85e3-3d110074acc0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:03.530052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec45a14-cb78-4a91-ac80-7a6075fc3987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:03.531004 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec45a14-cb78-4a91-ac80-7a6075fc3987 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:03.531431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec45a14-cb78-4a91-ac80-7a6075fc3987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:03.531829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec45a14-cb78-4a91-ac80-7a6075fc3987 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:03.532980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec45a14-cb78-4a91-ac80-7a6075fc3987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:03.533549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec45a14-cb78-4a91-ac80-7a6075fc3987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:03.535939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec45a14-cb78-4a91-ac80-7a6075fc3987 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:03.559975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 868/1737] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:08:03.560986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec45a14-cb78-4a91-ac80-7a6075fc3987 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:03.600053 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec45a14-cb78-4a91-ac80-7a6075fc3987 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:03.614618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a389c9-1c0d-485f-9afc-9c68546488c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:03.616112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a389c9-1c0d-485f-9afc-9c68546488c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:03.617236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a389c9-1c0d-485f-9afc-9c68546488c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:03.617868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a389c9-1c0d-485f-9afc-9c68546488c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:03.618867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a389c9-1c0d-485f-9afc-9c68546488c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:03.623012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a389c9-1c0d-485f-9afc-9c68546488c2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:03.659173 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbe471-4e99-4995-b3d0-763eca933d0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:03.660111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbe471-4e99-4995-b3d0-763eca933d0e service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:03.662193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbe471-4e99-4995-b3d0-763eca933d0e service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:03.662418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbe471-4e99-4995-b3d0-763eca933d0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:03.671966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-adcbe471-4e99-4995-b3d0-763eca933d0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:03.714241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 869/1738] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:03 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:03.716261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a389c9-1c0d-485f-9afc-9c68546488c2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:03.840052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a389c9-1c0d-485f-9afc-9c68546488c2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:03.849222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab90eb-162c-41a2-8e87-103c1ebecf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:03.850344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab90eb-162c-41a2-8e87-103c1ebecf13 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:03.850945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab90eb-162c-41a2-8e87-103c1ebecf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:03.851654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab90eb-162c-41a2-8e87-103c1ebecf13 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:03.852760 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab90eb-162c-41a2-8e87-103c1ebecf13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:03.856744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab90eb-162c-41a2-8e87-103c1ebecf13 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:03.931843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 870/1739] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:03 2022] POST /identity/v3/users => generated 282 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:03.943610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab90eb-162c-41a2-8e87-103c1ebecf13 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:03.949243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-80ab90eb-162c-41a2-8e87-103c1ebecf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:03.996088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab90eb-162c-41a2-8e87-103c1ebecf13 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:04.007056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:04.008899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:04.009210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:04.009528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] PATH_INFO: `/v3/users/72a1bcf986cf4dc9aab1c8c74471cff2` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:04.013875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a1bcf986cf4dc9aab1c8c74471cff2)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:04.015875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:04.021629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbe471-4e99-4995-b3d0-763eca933d0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:04.023399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbe471-4e99-4995-b3d0-763eca933d0e service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:04.027074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:04.064430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 870/1740] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 890 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:08:04.065767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbe471-4e99-4995-b3d0-763eca933d0e service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:04.098634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbe471-4e99-4995-b3d0-763eca933d0e service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:04.136442 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551a1f4-992e-412b-aeda-4e2e91ee38d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:04.137193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a1f4-992e-412b-aeda-4e2e91ee38d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:04.137487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a1f4-992e-412b-aeda-4e2e91ee38d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:04.137791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a1f4-992e-412b-aeda-4e2e91ee38d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:04.138555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551a1f4-992e-412b-aeda-4e2e91ee38d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:04.140705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551a1f4-992e-412b-aeda-4e2e91ee38d1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:04.180768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 871/1741] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:04.185943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551a1f4-992e-412b-aeda-4e2e91ee38d1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:04.211110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551a1f4-992e-412b-aeda-4e2e91ee38d1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:04.213360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a1bcf986cf4dc9aab1c8c74471cff2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:04.215628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a1bcf986cf4dc9aab1c8c74471cff2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:04.225537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd2d43-37e1-48bf-bf89-b56e64dfdd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:04.226505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd2d43-37e1-48bf-bf89-b56e64dfdd10 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:04.228799 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd2d43-37e1-48bf-bf89-b56e64dfdd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:04.229200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd2d43-37e1-48bf-bf89-b56e64dfdd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:04.230999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd2d43-37e1-48bf-bf89-b56e64dfdd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:04.233265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd2d43-37e1-48bf-bf89-b56e64dfdd10 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:04.278062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 872/1742] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:04.282372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd2d43-37e1-48bf-bf89-b56e64dfdd10 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:04.287279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b4cd2d43-37e1-48bf-bf89-b56e64dfdd10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:04.294965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a1bcf986cf4dc9aab1c8c74471cff2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:04.304175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a1bcf986cf4dc9aab1c8c74471cff2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:04.359563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e6a76286-34b1-4f5f-bc2f-c206459de538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a1bcf986cf4dc9aab1c8c74471cff2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:04.379674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd2d43-37e1-48bf-bf89-b56e64dfdd10 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:04.391731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07daf42d-d4c6-4e88-ac4b-24a4d3c65818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:04.393365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daf42d-d4c6-4e88-ac4b-24a4d3c65818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:04.393758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daf42d-d4c6-4e88-ac4b-24a4d3c65818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:04.394180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daf42d-d4c6-4e88-ac4b-24a4d3c65818 admin admin] PATH_INFO: `/v3/projects/07a15b8b2fb3446a988e1509d7c058db/users/648f64fb0afb461dae438ce997bb747b/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:04.410843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 871/1743] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:03 2022] DELETE /identity/v3/users/72a1bcf986cf4dc9aab1c8c74471cff2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:04.413210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352eb3-6d5e-42cb-9f55-dd835ef19e91 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:04.413500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352eb3-6d5e-42cb-9f55-dd835ef19e91 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:04.420623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352eb3-6d5e-42cb-9f55-dd835ef19e91 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:04.425627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 872/1744] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 18:08:04 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:08:04.427067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ab131-643c-413f-ad81-9cd2ece1bc04 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:04.427357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ab131-643c-413f-ad81-9cd2ece1bc04 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:04.427637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ab131-643c-413f-ad81-9cd2ece1bc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:04.468514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07daf42d-d4c6-4e88-ac4b-24a4d3c65818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a15b8b2fb3446a988e1509d7c058db, user_id=648f64fb0afb461dae438ce997bb747b, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:04.496355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07daf42d-d4c6-4e88-ac4b-24a4d3c65818 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:04.541755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d94ab131-643c-413f-ad81-9cd2ece1bc04 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:04.543089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d94ab131-643c-413f-ad81-9cd2ece1bc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:04.566006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 873/1745] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:04 2022] PUT /identity/v3/projects/07a15b8b2fb3446a988e1509d7c058db/users/648f64fb0afb461dae438ce997bb747b/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:04.580698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52dea-30c3-4350-8d7c-a8aaf4a35d13 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:04.580698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52dea-30c3-4350-8d7c-a8aaf4a35d13 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:04.580698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52dea-30c3-4350-8d7c-a8aaf4a35d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:04.706277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f0c52dea-30c3-4350-8d7c-a8aaf4a35d13 None None] MFA Rules not processed for user `648f64fb0afb461dae438ce997bb747b`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:04.708636 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f0c52dea-30c3-4350-8d7c-a8aaf4a35d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:04.744519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 873/1746] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:04.772039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c429f-99c7-423c-8a22-33d8557be538 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:04.772318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c429f-99c7-423c-8a22-33d8557be538 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:04.772599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c429f-99c7-423c-8a22-33d8557be538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:04.887587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-238c429f-99c7-423c-8a22-33d8557be538 None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:04.892398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-238c429f-99c7-423c-8a22-33d8557be538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:05.012059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 874/1747] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:05.013297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c52dea-30c3-4350-8d7c-a8aaf4a35d13 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:05.016269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f0c52dea-30c3-4350-8d7c-a8aaf4a35d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:05.071361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:05.164847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 874/1748] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 18:08:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:08:05.179418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c429f-99c7-423c-8a22-33d8557be538 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:05.206332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c52dea-30c3-4350-8d7c-a8aaf4a35d13 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:05.218975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7125c-13e1-424b-a766-03888400a9a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:05.219785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7125c-13e1-424b-a766-03888400a9a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:05.220664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c429f-99c7-423c-8a22-33d8557be538 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:05.220819 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7125c-13e1-424b-a766-03888400a9a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:05.221073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7125c-13e1-424b-a766-03888400a9a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:05.249762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7125c-13e1-424b-a766-03888400a9a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:05.251401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7125c-13e1-424b-a766-03888400a9a2 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:05.254983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b63ca-9189-4308-8994-869d8daaa676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:05.255675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b63ca-9189-4308-8994-869d8daaa676 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:05.255960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b63ca-9189-4308-8994-869d8daaa676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:05.256236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b63ca-9189-4308-8994-869d8daaa676 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:05.256939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b63ca-9189-4308-8994-869d8daaa676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:05.264119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b63ca-9189-4308-8994-869d8daaa676 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:05.285760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 875/1749] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:05.286656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7125c-13e1-424b-a766-03888400a9a2 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:05.292323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-49a7125c-13e1-424b-a766-03888400a9a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:05.302915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:05.351887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7125c-13e1-424b-a766-03888400a9a2 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:05.353586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 875/1750] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:05 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:05.355528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b63ca-9189-4308-8994-869d8daaa676 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:05.361999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c65b63ca-9189-4308-8994-869d8daaa676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:05.648751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:05.652111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:05.654603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:05.654960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] PATH_INFO: `/v3/projects/5a970d022be84305ae0a3cb3ab44c6d2` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:05.659296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a970d022be84305ae0a3cb3ab44c6d2)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:05.667359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:05.684837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b63ca-9189-4308-8994-869d8daaa676 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:05.727084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba5dd1-7c0b-4e3b-a3d7-61c49a25826e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:05.732793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba5dd1-7c0b-4e3b-a3d7-61c49a25826e service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:05.733092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba5dd1-7c0b-4e3b-a3d7-61c49a25826e service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:05.733380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba5dd1-7c0b-4e3b-a3d7-61c49a25826e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:05.766950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba5dd1-7c0b-4e3b-a3d7-61c49a25826e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:05.777210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba5dd1-7c0b-4e3b-a3d7-61c49a25826e service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:05.823261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 876/1751] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:05.823697 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a970d022be84305ae0a3cb3ab44c6d2', 'request_id': 'req-dc86c130-d16c-4cc2-aced-17380cc3cb83'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:05.824189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba5dd1-7c0b-4e3b-a3d7-61c49a25826e service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:05.837817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a970d022be84305ae0a3cb3ab44c6d2', 'request_id': 'req-dc86c130-d16c-4cc2-aced-17380cc3cb83'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:05.849268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a970d022be84305ae0a3cb3ab44c6d2', 'request_id': 'req-dc86c130-d16c-4cc2-aced-17380cc3cb83'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:05.857930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba5dd1-7c0b-4e3b-a3d7-61c49a25826e service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:05.888911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] The token cache is being invalidate because project 5a970d022be84305ae0a3cb3ab44c6d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:05.889211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:05.890143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:05.895246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 876/1752] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:05 2022] DELETE /identity/v3/projects/5a970d022be84305ae0a3cb3ab44c6d2 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:05.896350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:05.897915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:06.076402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82b829-fe54-4eac-a5e7-35a2c67b1e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:06.077463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82b829-fe54-4eac-a5e7-35a2c67b1e3b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:06.077463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82b829-fe54-4eac-a5e7-35a2c67b1e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:06.077651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82b829-fe54-4eac-a5e7-35a2c67b1e3b admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:06.080543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82b829-fe54-4eac-a5e7-35a2c67b1e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:06.089012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82b829-fe54-4eac-a5e7-35a2c67b1e3b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:06.112559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:06.152876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86c130-d16c-4cc2-aced-17380cc3cb83 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:06.164012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:06.164921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:06.165211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:06.165491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] PATH_INFO: `/v3/users/0fd870b27d5242f4b1471a2cf44b8aec` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:06.169653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd870b27d5242f4b1471a2cf44b8aec)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:06.177889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:06.186872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 877/1753] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:05 2022] POST /identity/v3/users => generated 289 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:06.202893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82b829-fe54-4eac-a5e7-35a2c67b1e3b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:06.214992 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0f82b829-fe54-4eac-a5e7-35a2c67b1e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:06.292414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82b829-fe54-4eac-a5e7-35a2c67b1e3b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:06.293115 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd870b27d5242f4b1471a2cf44b8aec'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:06.328193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b095e-4f1e-49e0-bef0-52fdb4725ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:06.332411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b095e-4f1e-49e0-bef0-52fdb4725ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:06.332733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b095e-4f1e-49e0-bef0-52fdb4725ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:06.333019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b095e-4f1e-49e0-bef0-52fdb4725ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:06.333784 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b095e-4f1e-49e0-bef0-52fdb4725ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:06.335393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd870b27d5242f4b1471a2cf44b8aec'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:06.343217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd870b27d5242f4b1471a2cf44b8aec'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:06.347385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b095e-4f1e-49e0-bef0-52fdb4725ecf admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:06.349135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd870b27d5242f4b1471a2cf44b8aec'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:06.379774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd870b27d5242f4b1471a2cf44b8aec'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:06.415437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 878/1754] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:06.416911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 877/1755] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:05 2022] DELETE /identity/v3/users/0fd870b27d5242f4b1471a2cf44b8aec => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:06.421488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b095e-4f1e-49e0-bef0-52fdb4725ecf admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:06.426011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-787b095e-4f1e-49e0-bef0-52fdb4725ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:06.488923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b095e-4f1e-49e0-bef0-52fdb4725ecf admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:06.687693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:06.705619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2049db-87da-4a0d-9836-0630e6dbed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:06.707041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2049db-87da-4a0d-9836-0630e6dbed7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:06.707533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2049db-87da-4a0d-9836-0630e6dbed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:06.707984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2049db-87da-4a0d-9836-0630e6dbed7a admin admin] PATH_INFO: `/v3/projects/0e54a7fcdd884661ac02e238baa3e714/users/fea8eda41eda442e9010cc35d4841ae7/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:06.736388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2049db-87da-4a0d-9836-0630e6dbed7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e54a7fcdd884661ac02e238baa3e714, user_id=fea8eda41eda442e9010cc35d4841ae7, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:06.746781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2049db-87da-4a0d-9836-0630e6dbed7a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:06.788223 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 879/1756] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:06 2022] PUT /identity/v3/projects/0e54a7fcdd884661ac02e238baa3e714/users/fea8eda41eda442e9010cc35d4841ae7/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:06.792893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:06.827522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d015e08-1a8a-4b25-b460-dc607eb1efe2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:07.099272 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ab4ea-1b8b-4544-aeaf-b74e53760709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:07.100033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ab4ea-1b8b-4544-aeaf-b74e53760709 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:07.100324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ab4ea-1b8b-4544-aeaf-b74e53760709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:07.100606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ab4ea-1b8b-4544-aeaf-b74e53760709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:07.101375 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ab4ea-1b8b-4544-aeaf-b74e53760709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:07.103093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ab4ea-1b8b-4544-aeaf-b74e53760709 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:07.151310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 878/1757] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:07.152228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2049db-87da-4a0d-9836-0630e6dbed7a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:07.177533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2049db-87da-4a0d-9836-0630e6dbed7a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:07.201434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed2e29-6bde-4089-972a-a32f5abcf307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:07.211267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed2e29-6bde-4089-972a-a32f5abcf307 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:07.211566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed2e29-6bde-4089-972a-a32f5abcf307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:07.211923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed2e29-6bde-4089-972a-a32f5abcf307 admin admin] PATH_INFO: `/v3/projects/0e54a7fcdd884661ac02e238baa3e714/users/fea8eda41eda442e9010cc35d4841ae7/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:07.236308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed2e29-6bde-4089-972a-a32f5abcf307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e54a7fcdd884661ac02e238baa3e714, user_id=fea8eda41eda442e9010cc35d4841ae7, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:07.239141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed2e29-6bde-4089-972a-a32f5abcf307 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:07.264028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 880/1758] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:07 2022] PUT /identity/v3/projects/0e54a7fcdd884661ac02e238baa3e714/users/fea8eda41eda442e9010cc35d4841ae7/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:07.275769 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56a448-930c-4af2-9e74-dc6a091003da None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:07.276080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56a448-930c-4af2-9e74-dc6a091003da None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:07.276346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56a448-930c-4af2-9e74-dc6a091003da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:07.354775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6e56a448-930c-4af2-9e74-dc6a091003da None None] MFA Rules not processed for user `fea8eda41eda442e9010cc35d4841ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:07.356507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6e56a448-930c-4af2-9e74-dc6a091003da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:07.467764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:07.547801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed2e29-6bde-4089-972a-a32f5abcf307 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:07.559889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 879/1759] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:07.560411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c7ed2e29-6bde-4089-972a-a32f5abcf307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:07.587016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56a448-930c-4af2-9e74-dc6a091003da None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:07.591264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6e56a448-930c-4af2-9e74-dc6a091003da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:07.799122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed2e29-6bde-4089-972a-a32f5abcf307 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:07.802827 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56a448-930c-4af2-9e74-dc6a091003da None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:07.819331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f7ebe-6fbe-4c2f-b929-cd3a9ad7579a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:07.820026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f7ebe-6fbe-4c2f-b929-cd3a9ad7579a service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:07.822281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f7ebe-6fbe-4c2f-b929-cd3a9ad7579a service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:07.823355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f7ebe-6fbe-4c2f-b929-cd3a9ad7579a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:07.823723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:07.824612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:07.824902 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:07.825182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] PATH_INFO: `/v3/projects/78a7191c10ba4a36baa4fda3a6becdf7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:07.831751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a7191c10ba4a36baa4fda3a6becdf7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:07.833724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:07.870172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f7ebe-6fbe-4c2f-b929-cd3a9ad7579a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:07.874955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f7ebe-6fbe-4c2f-b929-cd3a9ad7579a service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:07.932513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 880/1760] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:08:07.993753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a7191c10ba4a36baa4fda3a6becdf7', 'request_id': 'req-cf627d04-bf3a-401c-9996-e88d3783cd50'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:08.010186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a7191c10ba4a36baa4fda3a6becdf7', 'request_id': 'req-cf627d04-bf3a-401c-9996-e88d3783cd50'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:08.022044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a7191c10ba4a36baa4fda3a6becdf7', 'request_id': 'req-cf627d04-bf3a-401c-9996-e88d3783cd50'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:08.075302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] The token cache is being invalidate because project 78a7191c10ba4a36baa4fda3a6becdf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:08.075600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:08.079838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:08.087465 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 881/1761] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:07 2022] DELETE /identity/v3/projects/78a7191c10ba4a36baa4fda3a6becdf7 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:08.088832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f7ebe-6fbe-4c2f-b929-cd3a9ad7579a service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:08.106721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:08.108191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:08.108742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f7ebe-6fbe-4c2f-b929-cd3a9ad7579a service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:08.409474 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:08.411713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:08.411889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:08.413999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] PATH_INFO: `/v3/users/34d705d260d54fe59f39e8c9c327bfcf` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:08.419708 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d705d260d54fe59f39e8c9c327bfcf)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:08.421665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:08.559917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d705d260d54fe59f39e8c9c327bfcf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:08.593089 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d705d260d54fe59f39e8c9c327bfcf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:08.595410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d705d260d54fe59f39e8c9c327bfcf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:08.596029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d705d260d54fe59f39e8c9c327bfcf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:08.649856 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d705d260d54fe59f39e8c9c327bfcf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:08.677282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf627d04-bf3a-401c-9996-e88d3783cd50 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:08.686057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 881/1762] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:08 2022] DELETE /identity/v3/users/34d705d260d54fe59f39e8c9c327bfcf => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:08.697207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:08.902962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91205350-e8e6-4e85-9b8c-3d4d25d4376f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:08.903663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91205350-e8e6-4e85-9b8c-3d4d25d4376f service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:08.904007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91205350-e8e6-4e85-9b8c-3d4d25d4376f service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:08.904429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91205350-e8e6-4e85-9b8c-3d4d25d4376f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:08.913332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-91205350-e8e6-4e85-9b8c-3d4d25d4376f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:09.044826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:09.046376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:09.076162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:09.193566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91205350-e8e6-4e85-9b8c-3d4d25d4376f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:09.202294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91205350-e8e6-4e85-9b8c-3d4d25d4376f service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:09.259814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 882/1763] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 1153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:08:09.337030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4193d-3dab-4adf-8591-fe2b65041b22 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:09.353060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:09.354671 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:09.357160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:09.357456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] PATH_INFO: `/v3/projects/351cc41e96864775b9f156b0619a4fa3` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:09.375515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351cc41e96864775b9f156b0619a4fa3)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:09.385277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:09.531913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351cc41e96864775b9f156b0619a4fa3', 'request_id': 'req-2c30a944-abcc-42e4-b863-e1ad584119c2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:09.577047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351cc41e96864775b9f156b0619a4fa3', 'request_id': 'req-2c30a944-abcc-42e4-b863-e1ad584119c2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:09.587715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351cc41e96864775b9f156b0619a4fa3', 'request_id': 'req-2c30a944-abcc-42e4-b863-e1ad584119c2'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:09.603374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] The token cache is being invalidate because project 351cc41e96864775b9f156b0619a4fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:09.603374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:09.623536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2c30a944-abcc-42e4-b863-e1ad584119c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:09.627531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 882/1764] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:09 2022] DELETE /identity/v3/projects/351cc41e96864775b9f156b0619a4fa3 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:09.632216 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9d11d-94f3-4578-8fd9-0296d4a37c6f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:09.632509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9d11d-94f3-4578-8fd9-0296d4a37c6f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:09.632790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9d11d-94f3-4578-8fd9-0296d4a37c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:09.688226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-85a9d11d-94f3-4578-8fd9-0296d4a37c6f None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:09.691136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-85a9d11d-94f3-4578-8fd9-0296d4a37c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:09.895015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 883/1765] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:09.902433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581529bd-6408-413f-92ba-19b79501af13 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:09.902974 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581529bd-6408-413f-92ba-19b79501af13 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:09.903266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581529bd-6408-413f-92ba-19b79501af13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:09.940499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-581529bd-6408-413f-92ba-19b79501af13 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:09.942497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-581529bd-6408-413f-92ba-19b79501af13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:10.041377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9d11d-94f3-4578-8fd9-0296d4a37c6f None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:10.042054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 883/1766] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:10.057467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9d11d-94f3-4578-8fd9-0296d4a37c6f None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:10.073181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0b518-c8f6-4f6b-b3d2-7a7a6e526684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:10.074157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0b518-c8f6-4f6b-b3d2-7a7a6e526684 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:10.074555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0b518-c8f6-4f6b-b3d2-7a7a6e526684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:10.075977 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0b518-c8f6-4f6b-b3d2-7a7a6e526684 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:10.076850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0b518-c8f6-4f6b-b3d2-7a7a6e526684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:10.077297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0b518-c8f6-4f6b-b3d2-7a7a6e526684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:10.079091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0b518-c8f6-4f6b-b3d2-7a7a6e526684 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:10.116528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 884/1767] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:08:10.121975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581529bd-6408-413f-92ba-19b79501af13 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:10.139219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581529bd-6408-413f-92ba-19b79501af13 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:10.155797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58147f88-01dd-46ee-bfab-713f872fa111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:10.160691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58147f88-01dd-46ee-bfab-713f872fa111 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:10.162021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58147f88-01dd-46ee-bfab-713f872fa111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:10.162742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58147f88-01dd-46ee-bfab-713f872fa111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:10.163680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58147f88-01dd-46ee-bfab-713f872fa111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:10.167549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58147f88-01dd-46ee-bfab-713f872fa111 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:10.273701 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 884/1768] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:10 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:10.273905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0b518-c8f6-4f6b-b3d2-7a7a6e526684 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:10.289917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0b518-c8f6-4f6b-b3d2-7a7a6e526684 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:10.450613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:10.485200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7003773-a019-44c1-a31b-24f4916ae491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:10.486206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7003773-a019-44c1-a31b-24f4916ae491 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:10.486485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7003773-a019-44c1-a31b-24f4916ae491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:10.486825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7003773-a019-44c1-a31b-24f4916ae491 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:10.487887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7003773-a019-44c1-a31b-24f4916ae491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:10.496472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7003773-a019-44c1-a31b-24f4916ae491 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:10.562250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 885/1769] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:10 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:08:10.567314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58147f88-01dd-46ee-bfab-713f872fa111 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:10.590559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58147f88-01dd-46ee-bfab-713f872fa111 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:10.602484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6b26-02aa-44eb-b782-eea3eed47038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:10.603237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6b26-02aa-44eb-b782-eea3eed47038 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:10.603494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6b26-02aa-44eb-b782-eea3eed47038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:10.603821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6b26-02aa-44eb-b782-eea3eed47038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:10.604507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6b26-02aa-44eb-b782-eea3eed47038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:10.606149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6b26-02aa-44eb-b782-eea3eed47038 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:10.653103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7003773-a019-44c1-a31b-24f4916ae491 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:10.656902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 885/1770] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:10.675646 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7003773-a019-44c1-a31b-24f4916ae491 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:10.689660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991346e-41d5-4c71-805d-e8f1f0f4614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:10.692355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991346e-41d5-4c71-805d-e8f1f0f4614d admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:10.693338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991346e-41d5-4c71-805d-e8f1f0f4614d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:10.694684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991346e-41d5-4c71-805d-e8f1f0f4614d admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:10.695651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991346e-41d5-4c71-805d-e8f1f0f4614d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:10.700382 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991346e-41d5-4c71-805d-e8f1f0f4614d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:10.753663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6b26-02aa-44eb-b782-eea3eed47038 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:10.760604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 886/1771] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:08:10.770346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6b26-02aa-44eb-b782-eea3eed47038 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:10.783645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38ef61-44ac-481d-bffe-823fa0ff549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:10.787751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38ef61-44ac-481d-bffe-823fa0ff549c admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:10.797027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38ef61-44ac-481d-bffe-823fa0ff549c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:10.797424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38ef61-44ac-481d-bffe-823fa0ff549c admin admin] PATH_INFO: `/v3/projects/b6d6dd0d8d044d2bac4e81c1b7530a9b/users/89063e6ef030461eaed223b2ac0e0c84/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:10.846864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38ef61-44ac-481d-bffe-823fa0ff549c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d6dd0d8d044d2bac4e81c1b7530a9b, user_id=89063e6ef030461eaed223b2ac0e0c84, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:10.853322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38ef61-44ac-481d-bffe-823fa0ff549c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:10.899323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 886/1772] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:10 2022] PUT /identity/v3/projects/b6d6dd0d8d044d2bac4e81c1b7530a9b/users/89063e6ef030461eaed223b2ac0e0c84/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:10.900637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef96af-ec4b-43bd-b31f-41e545560b00 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:10.901196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef96af-ec4b-43bd-b31f-41e545560b00 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:10.901700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef96af-ec4b-43bd-b31f-41e545560b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:10.963047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d5ef96af-ec4b-43bd-b31f-41e545560b00 None None] MFA Rules not processed for user `89063e6ef030461eaed223b2ac0e0c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:10.964248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d5ef96af-ec4b-43bd-b31f-41e545560b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:11.094166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38ef61-44ac-481d-bffe-823fa0ff549c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:11.104518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8b38ef61-44ac-481d-bffe-823fa0ff549c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:11.198007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:11.297447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38ef61-44ac-481d-bffe-823fa0ff549c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:11.304293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:11.305249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:11.305537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:11.306142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] PATH_INFO: `/v3/users/02914e2a1ab84a39be16053182906718` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:11.307764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] RBAC: Authorizing `identity:delete_user(user_id=02914e2a1ab84a39be16053182906718)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:11.311807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:11.323400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 887/1773] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:11.340352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef96af-ec4b-43bd-b31f-41e545560b00 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:11.373652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef96af-ec4b-43bd-b31f-41e545560b00 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:11.387762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c23be2-c173-4265-8421-2e4a733b8dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:11.390278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23be2-c173-4265-8421-2e4a733b8dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:11.391286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23be2-c173-4265-8421-2e4a733b8dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:11.393823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23be2-c173-4265-8421-2e4a733b8dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:11.396474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c23be2-c173-4265-8421-2e4a733b8dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:11.398715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c23be2-c173-4265-8421-2e4a733b8dfb admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:11.431944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02914e2a1ab84a39be16053182906718'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:11.451851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02914e2a1ab84a39be16053182906718'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:11.454341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02914e2a1ab84a39be16053182906718'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:11.455191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02914e2a1ab84a39be16053182906718'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:11.457130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 888/1774] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:11 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:11.464275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c23be2-c173-4265-8421-2e4a733b8dfb admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:11.473055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-82c23be2-c173-4265-8421-2e4a733b8dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:11.484852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5eaaba8a-d4f9-47e4-95ef-2be27938581f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02914e2a1ab84a39be16053182906718'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:11.516602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 887/1775] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:11 2022] DELETE /identity/v3/users/02914e2a1ab84a39be16053182906718 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:11.522353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40c19b-9273-4659-92c0-24f30fff6027 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:11.522649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40c19b-9273-4659-92c0-24f30fff6027 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:11.522961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40c19b-9273-4659-92c0-24f30fff6027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:11.562186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4f40c19b-9273-4659-92c0-24f30fff6027 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:11.564833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4f40c19b-9273-4659-92c0-24f30fff6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:11.611405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c23be2-c173-4265-8421-2e4a733b8dfb admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:11.704708 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 888/1776] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:11.707283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40c19b-9273-4659-92c0-24f30fff6027 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:11.710521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4f40c19b-9273-4659-92c0-24f30fff6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:11.713296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:11.745862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157349-1865-4093-a83d-8d5412c94060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:11.746688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157349-1865-4093-a83d-8d5412c94060 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:11.761790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157349-1865-4093-a83d-8d5412c94060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:11.762099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157349-1865-4093-a83d-8d5412c94060 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:11.762919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7157349-1865-4093-a83d-8d5412c94060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:11.765446 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7157349-1865-4093-a83d-8d5412c94060 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:11.802137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 889/1777] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:11 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:11.806095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157349-1865-4093-a83d-8d5412c94060 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:11.826140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40c19b-9273-4659-92c0-24f30fff6027 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:11.826653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157349-1865-4093-a83d-8d5412c94060 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:11.830770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd9817-c11c-4568-a872-f553e9d20b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:11.831322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd9817-c11c-4568-a872-f553e9d20b48 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:11.831690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd9817-c11c-4568-a872-f553e9d20b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:11.831973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd9817-c11c-4568-a872-f553e9d20b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:11.836788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c1766-8780-4849-8c42-d01124afb0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:11.838367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c1766-8780-4849-8c42-d01124afb0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:11.838891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c1766-8780-4849-8c42-d01124afb0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:11.839397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c1766-8780-4849-8c42-d01124afb0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:11.840519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c1766-8780-4849-8c42-d01124afb0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:11.840644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:11.843723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd9817-c11c-4568-a872-f553e9d20b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:11.844553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c1766-8780-4849-8c42-d01124afb0ee admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:11.846583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd9817-c11c-4568-a872-f553e9d20b48 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:11.861429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 889/1778] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:11.882620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 890/1779] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:08:11.886804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd9817-c11c-4568-a872-f553e9d20b48 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:11.904494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd9817-c11c-4568-a872-f553e9d20b48 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:11.911955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fbbe6-7c9a-4ecb-8f05-3247ed04644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:11.912850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fbbe6-7c9a-4ecb-8f05-3247ed04644d admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:11.913335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fbbe6-7c9a-4ecb-8f05-3247ed04644d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:11.913657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fbbe6-7c9a-4ecb-8f05-3247ed04644d admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:11.914526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fbbe6-7c9a-4ecb-8f05-3247ed04644d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:11.916484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fbbe6-7c9a-4ecb-8f05-3247ed04644d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:11.931852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 890/1780] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:11.935800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c1766-8780-4849-8c42-d01124afb0ee admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:11.948343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c1766-8780-4849-8c42-d01124afb0ee admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:11.954829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861ea23-8ace-4657-becf-c8aead396f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:11.955850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861ea23-8ace-4657-becf-c8aead396f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:11.957972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861ea23-8ace-4657-becf-c8aead396f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:11.957972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861ea23-8ace-4657-becf-c8aead396f41 admin admin] PATH_INFO: `/v3/projects/70816748710143fc9536eaa48a2e291d/users/bc3e4675d3e74ea2ba8d827df2f7b923/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:11.979584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861ea23-8ace-4657-becf-c8aead396f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70816748710143fc9536eaa48a2e291d, user_id=bc3e4675d3e74ea2ba8d827df2f7b923, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:11.984230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861ea23-8ace-4657-becf-c8aead396f41 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:12.049945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 891/1781] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:11 2022] PUT /identity/v3/projects/70816748710143fc9536eaa48a2e291d/users/bc3e4675d3e74ea2ba8d827df2f7b923/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:12.061028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212500da-6062-44b0-ad9b-69426258a1b9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:12.061223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212500da-6062-44b0-ad9b-69426258a1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:12.061491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212500da-6062-44b0-ad9b-69426258a1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:12.130814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-212500da-6062-44b0-ad9b-69426258a1b9 None None] MFA Rules not processed for user `bc3e4675d3e74ea2ba8d827df2f7b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:12.132323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-212500da-6062-44b0-ad9b-69426258a1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:12.133968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861ea23-8ace-4657-becf-c8aead396f41 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:12.135991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4861ea23-8ace-4657-becf-c8aead396f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:12.269517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 891/1782] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:12.271303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212500da-6062-44b0-ad9b-69426258a1b9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:12.378554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861ea23-8ace-4657-becf-c8aead396f41 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:12.397856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:12.399184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:12.399834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:12.400180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] PATH_INFO: `/v3/projects/5aece902be57480b9aef7d164770ed84` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:12.403862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aece902be57480b9aef7d164770ed84)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:12.415830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:12.433321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212500da-6062-44b0-ad9b-69426258a1b9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:12.447381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f7e8a-8171-43fc-82c3-19f3f84070f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:12.449206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f7e8a-8171-43fc-82c3-19f3f84070f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:12.449510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f7e8a-8171-43fc-82c3-19f3f84070f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:12.449802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f7e8a-8171-43fc-82c3-19f3f84070f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:12.450522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f7e8a-8171-43fc-82c3-19f3f84070f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:12.452568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f7e8a-8171-43fc-82c3-19f3f84070f0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:12.501664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aece902be57480b9aef7d164770ed84', 'request_id': 'req-9a179ebf-a19c-463d-9dd3-8c958b9d668a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:12.520240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 892/1783] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:12 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:12.524065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f7e8a-8171-43fc-82c3-19f3f84070f0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:12.531783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aece902be57480b9aef7d164770ed84', 'request_id': 'req-9a179ebf-a19c-463d-9dd3-8c958b9d668a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:12.546318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aece902be57480b9aef7d164770ed84', 'request_id': 'req-9a179ebf-a19c-463d-9dd3-8c958b9d668a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:12.578161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] The token cache is being invalidate because project 5aece902be57480b9aef7d164770ed84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:12.578465 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:12.579251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:12.583822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 892/1784] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:12 2022] DELETE /identity/v3/projects/5aece902be57480b9aef7d164770ed84 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:12.584886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:12.586392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:12.674363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f7e8a-8171-43fc-82c3-19f3f84070f0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:12.676707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:12.680725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28985b4d-d7cb-4573-a669-5967f1c93ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:12.681481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28985b4d-d7cb-4573-a669-5967f1c93ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:12.681775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28985b4d-d7cb-4573-a669-5967f1c93ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:12.682057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28985b4d-d7cb-4573-a669-5967f1c93ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:12.682813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28985b4d-d7cb-4573-a669-5967f1c93ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:12.684818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28985b4d-d7cb-4573-a669-5967f1c93ce6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:12.694422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:12.740523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 893/1785] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:12 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:12.744753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28985b4d-d7cb-4573-a669-5967f1c93ce6 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:12.749953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-28985b4d-d7cb-4573-a669-5967f1c93ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:12.786582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28985b4d-d7cb-4573-a669-5967f1c93ce6 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:12.794498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a179ebf-a19c-463d-9dd3-8c958b9d668a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:12.801780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979cc9-7d8d-4581-9252-d86e3702d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:12.803257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979cc9-7d8d-4581-9252-d86e3702d032 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:12.804508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979cc9-7d8d-4581-9252-d86e3702d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:12.805603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979cc9-7d8d-4581-9252-d86e3702d032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:12.807214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21979cc9-7d8d-4581-9252-d86e3702d032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:12.808024 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:12.809867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21979cc9-7d8d-4581-9252-d86e3702d032 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:12.811645 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:12.812041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:12.812333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] PATH_INFO: `/v3/users/4c7000eda8064dd68eab43e307b0c819` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:12.816733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7000eda8064dd68eab43e307b0c819)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:12.818726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:12.842140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 894/1786] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:12.843047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979cc9-7d8d-4581-9252-d86e3702d032 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:12.867345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979cc9-7d8d-4581-9252-d86e3702d032 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:12.880438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ecb85-118b-48dc-b0a1-3c621039d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:12.881297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ecb85-118b-48dc-b0a1-3c621039d137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:12.881986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ecb85-118b-48dc-b0a1-3c621039d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:12.882280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ecb85-118b-48dc-b0a1-3c621039d137 admin admin] PATH_INFO: `/v3/projects/54cbc21e56454a7db1699b3f32a3df65/users/9485fac88a7a448a8139caecc188d5f3/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:12.944606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ecb85-118b-48dc-b0a1-3c621039d137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cbc21e56454a7db1699b3f32a3df65, user_id=9485fac88a7a448a8139caecc188d5f3, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:12.951609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ecb85-118b-48dc-b0a1-3c621039d137 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:12.955857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7000eda8064dd68eab43e307b0c819'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:12.956531 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7000eda8064dd68eab43e307b0c819'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:12.968346 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7000eda8064dd68eab43e307b0c819'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:12.971175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7000eda8064dd68eab43e307b0c819'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:12.984029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 895/1787] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:12 2022] PUT /identity/v3/projects/54cbc21e56454a7db1699b3f32a3df65/users/9485fac88a7a448a8139caecc188d5f3/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:12.986811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ecb85-118b-48dc-b0a1-3c621039d137 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:12.991513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4f7ecb85-118b-48dc-b0a1-3c621039d137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:13.020102 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7000eda8064dd68eab43e307b0c819'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:13.060696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 893/1788] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:12 2022] DELETE /identity/v3/users/4c7000eda8064dd68eab43e307b0c819 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:13.151192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ecb85-118b-48dc-b0a1-3c621039d137 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:13.297187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79942006-86e8-4eed-8f22-e239ea8b506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:13.301459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942006-86e8-4eed-8f22-e239ea8b506d admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:13.301742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942006-86e8-4eed-8f22-e239ea8b506d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:13.302015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942006-86e8-4eed-8f22-e239ea8b506d admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:13.302782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79942006-86e8-4eed-8f22-e239ea8b506d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:13.304421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79942006-86e8-4eed-8f22-e239ea8b506d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:13.327562 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 896/1789] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:13.329551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:13.344707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b1511-495a-4d94-ac59-3401feab8e1a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:13.349167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79942006-86e8-4eed-8f22-e239ea8b506d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:13.353121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-79942006-86e8-4eed-8f22-e239ea8b506d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:13.370329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1c631-621c-4cdb-90be-bfa027b71d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:13.376588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1c631-621c-4cdb-90be-bfa027b71d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:13.377041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1c631-621c-4cdb-90be-bfa027b71d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:13.377455 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1c631-621c-4cdb-90be-bfa027b71d1d admin admin] PATH_INFO: `/v3/projects/54cbc21e56454a7db1699b3f32a3df65/users/9485fac88a7a448a8139caecc188d5f3/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:13.383169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1c631-621c-4cdb-90be-bfa027b71d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cbc21e56454a7db1699b3f32a3df65, user_id=9485fac88a7a448a8139caecc188d5f3, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:13.389410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1c631-621c-4cdb-90be-bfa027b71d1d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:13.390752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79942006-86e8-4eed-8f22-e239ea8b506d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:13.411435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:13.413595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:13.413944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:13.414317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] PATH_INFO: `/v3/projects/969814a1819041d7bc3b5cda7c3d54f5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:13.418658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969814a1819041d7bc3b5cda7c3d54f5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:13.421417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:13.436700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 894/1790] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:13 2022] PUT /identity/v3/projects/54cbc21e56454a7db1699b3f32a3df65/users/9485fac88a7a448a8139caecc188d5f3/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:13.453295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84878aab-8ba0-4fed-9e40-b91514bff697 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:13.454423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84878aab-8ba0-4fed-9e40-b91514bff697 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:13.455956 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84878aab-8ba0-4fed-9e40-b91514bff697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:13.558027 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-84878aab-8ba0-4fed-9e40-b91514bff697 None None] MFA Rules not processed for user `9485fac88a7a448a8139caecc188d5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:13.572474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-84878aab-8ba0-4fed-9e40-b91514bff697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:13.592067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969814a1819041d7bc3b5cda7c3d54f5', 'request_id': 'req-2084959a-a00e-4b9c-a7d3-af57dfa86f53'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:13.597323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:13.608210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969814a1819041d7bc3b5cda7c3d54f5', 'request_id': 'req-2084959a-a00e-4b9c-a7d3-af57dfa86f53'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:13.622604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969814a1819041d7bc3b5cda7c3d54f5', 'request_id': 'req-2084959a-a00e-4b9c-a7d3-af57dfa86f53'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:13.655430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] The token cache is being invalidate because project 969814a1819041d7bc3b5cda7c3d54f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:13.655719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:13.658347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2084959a-a00e-4b9c-a7d3-af57dfa86f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:13.665561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 897/1791] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:13 2022] DELETE /identity/v3/projects/969814a1819041d7bc3b5cda7c3d54f5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:13.667108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a22b-5cb2-4880-ab52-da9c25cef9c3 None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:13.667400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a22b-5cb2-4880-ab52-da9c25cef9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:13.668615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a22b-5cb2-4880-ab52-da9c25cef9c3 None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:13.672086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 898/1792] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 18:08:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:08:13.674164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e6a17-6d2b-4dbd-aafd-44a87b8170c8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:13.692813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e6a17-6d2b-4dbd-aafd-44a87b8170c8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:13.694204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e6a17-6d2b-4dbd-aafd-44a87b8170c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:13.771802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a56e6a17-6d2b-4dbd-aafd-44a87b8170c8 None None] MFA Rules not processed for user `32e9879d092b4c819f1f5607f42cc364`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:13.773051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a56e6a17-6d2b-4dbd-aafd-44a87b8170c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:13.813155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 895/1793] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:08:13.815138 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84878aab-8ba0-4fed-9e40-b91514bff697 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:13.821417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-84878aab-8ba0-4fed-9e40-b91514bff697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:13.873903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:13.902588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 899/1794] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:13.904252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4f9a-edad-43a6-b51c-0ae9cce00f6a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:13.904548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4f9a-edad-43a6-b51c-0ae9cce00f6a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:13.904975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4f9a-edad-43a6-b51c-0ae9cce00f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:13.934350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-beda4f9a-edad-43a6-b51c-0ae9cce00f6a None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:13.935876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-beda4f9a-edad-43a6-b51c-0ae9cce00f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:13.988170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84878aab-8ba0-4fed-9e40-b91514bff697 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:14.013095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:14.013744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:14.014033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:14.014315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] PATH_INFO: `/v3/users/5f0cec08ea1d425fa69ddce602785a6b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:14.016797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0cec08ea1d425fa69ddce602785a6b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:14.018723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:14.138657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 900/1795] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 18:08:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:14.139599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda4f9a-edad-43a6-b51c-0ae9cce00f6a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:14.140911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0cec08ea1d425fa69ddce602785a6b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.141278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-beda4f9a-edad-43a6-b51c-0ae9cce00f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:14.142226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0cec08ea1d425fa69ddce602785a6b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.158186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0cec08ea1d425fa69ddce602785a6b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.159051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0cec08ea1d425fa69ddce602785a6b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.177898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0cec08ea1d425fa69ddce602785a6b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.216058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 896/1796] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:13 2022] DELETE /identity/v3/users/5f0cec08ea1d425fa69ddce602785a6b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:14.217057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:14.220104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:14.255279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda4f9a-edad-43a6-b51c-0ae9cce00f6a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:14.310775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:14.334977 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c9f6-ba40-443a-a84e-b322618cbe9e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:14.337934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ac034-bfd1-482a-bb23-19d04cd51eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:14.338566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ac034-bfd1-482a-bb23-19d04cd51eca service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:14.338956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ac034-bfd1-482a-bb23-19d04cd51eca service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:14.339239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ac034-bfd1-482a-bb23-19d04cd51eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:14.340360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:14.341427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:14.341808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6b1ac034-bfd1-482a-bb23-19d04cd51eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:14.345308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:14.345620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] PATH_INFO: `/v3/projects/f09d9a2ebae94946a5f6652a68b8e66b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:14.346974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09d9a2ebae94946a5f6652a68b8e66b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:14.348946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:14.407772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:14.416973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09d9a2ebae94946a5f6652a68b8e66b', 'request_id': 'req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.425775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ac034-bfd1-482a-bb23-19d04cd51eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:14.426738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09d9a2ebae94946a5f6652a68b8e66b', 'request_id': 'req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.427491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ac034-bfd1-482a-bb23-19d04cd51eca service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:14.435406 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09d9a2ebae94946a5f6652a68b8e66b', 'request_id': 'req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.438921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 901/1797] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:14.440112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ac034-bfd1-482a-bb23-19d04cd51eca service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:14.442220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6b1ac034-bfd1-482a-bb23-19d04cd51eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:14.462275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] The token cache is being invalidate because project f09d9a2ebae94946a5f6652a68b8e66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:14.462836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.463786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ab9cada6-bfeb-42d3-9e1f-e296d65930cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.468327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 897/1798] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:14 2022] DELETE /identity/v3/projects/f09d9a2ebae94946a5f6652a68b8e66b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:14.469719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d98b73-77c9-4345-a0ab-d11504ee6d9b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:14.470033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d98b73-77c9-4345-a0ab-d11504ee6d9b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:14.470333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d98b73-77c9-4345-a0ab-d11504ee6d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:14.515775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-08d98b73-77c9-4345-a0ab-d11504ee6d9b None None] MFA Rules not processed for user `8d08ba344a9349d99de16520d3ce5150`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:14.518392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-08d98b73-77c9-4345-a0ab-d11504ee6d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:14.590824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ac034-bfd1-482a-bb23-19d04cd51eca service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:14.609046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 898/1799] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:14.611404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c362e6-e8ed-4e54-8acf-7a0a3f9cdf99 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:14.611727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c362e6-e8ed-4e54-8acf-7a0a3f9cdf99 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:14.612012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c362e6-e8ed-4e54-8acf-7a0a3f9cdf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:14.631329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a9c362e6-e8ed-4e54-8acf-7a0a3f9cdf99 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:14.632613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a9c362e6-e8ed-4e54-8acf-7a0a3f9cdf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:14.756739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d4ddd-dd8c-40c5-9bdb-47065cfb7a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:14.757471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d4ddd-dd8c-40c5-9bdb-47065cfb7a9c service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:14.758065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d4ddd-dd8c-40c5-9bdb-47065cfb7a9c service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:14.758523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d4ddd-dd8c-40c5-9bdb-47065cfb7a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:14.761755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d79d4ddd-dd8c-40c5-9bdb-47065cfb7a9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:14.765058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 899/1800] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:14.767329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ec0d-1615-4c87-b407-ca39587844a5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:14.769175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ec0d-1615-4c87-b407-ca39587844a5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:14.769567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ec0d-1615-4c87-b407-ca39587844a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:14.779063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d4ddd-dd8c-40c5-9bdb-47065cfb7a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:14.784273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d4ddd-dd8c-40c5-9bdb-47065cfb7a9c service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:14.797255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 902/1801] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:14.799101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d4ddd-dd8c-40c5-9bdb-47065cfb7a9c service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:14.800619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d79d4ddd-dd8c-40c5-9bdb-47065cfb7a9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:14.812612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5a11ec0d-1615-4c87-b407-ca39587844a5 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:14.813848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5a11ec0d-1615-4c87-b407-ca39587844a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:14.826750 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 900/1802] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:14.831686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11ec0d-1615-4c87-b407-ca39587844a5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:14.843786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d4ddd-dd8c-40c5-9bdb-47065cfb7a9c service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:14.849569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11ec0d-1615-4c87-b407-ca39587844a5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:14.856007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc5e79-8c4e-4fc0-a5e4-d8f86cf26833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:14.857117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc5e79-8c4e-4fc0-a5e4-d8f86cf26833 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:14.857472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc5e79-8c4e-4fc0-a5e4-d8f86cf26833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:14.857676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc5e79-8c4e-4fc0-a5e4-d8f86cf26833 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:14.861718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc5e79-8c4e-4fc0-a5e4-d8f86cf26833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:14.862095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc5e79-8c4e-4fc0-a5e4-d8f86cf26833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:14.864000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc5e79-8c4e-4fc0-a5e4-d8f86cf26833 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:14.865600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:14.867783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:14.868966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:14.870088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] PATH_INFO: `/v3/projects/13d74e1fbdfa422b98a7ce15938b7326` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:14.873833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d74e1fbdfa422b98a7ce15938b7326)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:14.879245 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:14.879950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 901/1803] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:08:14.884676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:14.886520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc5e79-8c4e-4fc0-a5e4-d8f86cf26833 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:14.913070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc5e79-8c4e-4fc0-a5e4-d8f86cf26833 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:14.924980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac655951-4b35-4842-8c03-37ff2a7c813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:14.927387 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac655951-4b35-4842-8c03-37ff2a7c813d admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:14.927677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac655951-4b35-4842-8c03-37ff2a7c813d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:14.927959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac655951-4b35-4842-8c03-37ff2a7c813d admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:14.929840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac655951-4b35-4842-8c03-37ff2a7c813d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:14.932179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac655951-4b35-4842-8c03-37ff2a7c813d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:14.954819 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d74e1fbdfa422b98a7ce15938b7326', 'request_id': 'req-a119424a-630b-4cd8-90e7-859fdd43e701'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.964218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d74e1fbdfa422b98a7ce15938b7326', 'request_id': 'req-a119424a-630b-4cd8-90e7-859fdd43e701'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.971217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 902/1804] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:14 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:08:14.973613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d74e1fbdfa422b98a7ce15938b7326', 'request_id': 'req-a119424a-630b-4cd8-90e7-859fdd43e701'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.975267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac655951-4b35-4842-8c03-37ff2a7c813d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:14.995101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] The token cache is being invalidate because project 13d74e1fbdfa422b98a7ce15938b7326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:14.995386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.996342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a119424a-630b-4cd8-90e7-859fdd43e701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:14.998851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 903/1805] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:14 2022] DELETE /identity/v3/projects/13d74e1fbdfa422b98a7ce15938b7326 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:15.003453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38241e8-e894-4ea8-83fa-3451c5e0ce38 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.004206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38241e8-e894-4ea8-83fa-3451c5e0ce38 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.004660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38241e8-e894-4ea8-83fa-3451c5e0ce38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.027209 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:15.036767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e38241e8-e894-4ea8-83fa-3451c5e0ce38 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:15.038067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e38241e8-e894-4ea8-83fa-3451c5e0ce38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:15.091729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac655951-4b35-4842-8c03-37ff2a7c813d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.104272 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24139ad-5bf7-49f0-993a-f0abae443bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.105967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24139ad-5bf7-49f0-993a-f0abae443bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.106452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24139ad-5bf7-49f0-993a-f0abae443bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.107034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24139ad-5bf7-49f0-993a-f0abae443bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.108655 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24139ad-5bf7-49f0-993a-f0abae443bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.111670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24139ad-5bf7-49f0-993a-f0abae443bc1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.147982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 903/1806] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:14 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:08:15.149396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24139ad-5bf7-49f0-993a-f0abae443bc1 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.151657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c24139ad-5bf7-49f0-993a-f0abae443bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:15.169374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24139ad-5bf7-49f0-993a-f0abae443bc1 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.174469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 904/1807] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:08:15.176403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f97849-e671-4546-82ad-81d987afab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.177459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f97849-e671-4546-82ad-81d987afab08 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.177921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f97849-e671-4546-82ad-81d987afab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.178508 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f97849-e671-4546-82ad-81d987afab08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.179487 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f97849-e671-4546-82ad-81d987afab08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.181889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f97849-e671-4546-82ad-81d987afab08 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.182026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77201a2-aabf-43bb-b14b-08f15684bb26 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.182165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77201a2-aabf-43bb-b14b-08f15684bb26 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.183298 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77201a2-aabf-43bb-b14b-08f15684bb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.202962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 904/1808] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:15.212481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f97849-e671-4546-82ad-81d987afab08 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.229793 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f77201a2-aabf-43bb-b14b-08f15684bb26 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:15.231044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f77201a2-aabf-43bb-b14b-08f15684bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:15.237730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f97849-e671-4546-82ad-81d987afab08 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.255823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb16f4-2a58-4c49-a835-d5ea86af9b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.256053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 905/1809] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:15.257211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb16f4-2a58-4c49-a835-d5ea86af9b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.257448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb16f4-2a58-4c49-a835-d5ea86af9b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.257765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb16f4-2a58-4c49-a835-d5ea86af9b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.258746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb16f4-2a58-4c49-a835-d5ea86af9b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.260733 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77201a2-aabf-43bb-b14b-08f15684bb26 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.261503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb16f4-2a58-4c49-a835-d5ea86af9b0f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.277268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77201a2-aabf-43bb-b14b-08f15684bb26 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.291805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 905/1810] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:15.296351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb16f4-2a58-4c49-a835-d5ea86af9b0f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.319467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424a32c-4c09-439e-be41-5e68128e8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.321638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a32c-4c09-439e-be41-5e68128e8c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.321638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a32c-4c09-439e-be41-5e68128e8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.322089 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a32c-4c09-439e-be41-5e68128e8c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.322628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424a32c-4c09-439e-be41-5e68128e8c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:15.322984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424a32c-4c09-439e-be41-5e68128e8c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.335748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb16f4-2a58-4c49-a835-d5ea86af9b0f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.339900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424a32c-4c09-439e-be41-5e68128e8c40 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.350889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6715f-4351-4836-ba8d-1e8a79bc6fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.355088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6715f-4351-4836-ba8d-1e8a79bc6fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.355088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6715f-4351-4836-ba8d-1e8a79bc6fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.359521 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6715f-4351-4836-ba8d-1e8a79bc6fb0 admin admin] PATH_INFO: `/v3/projects/636c75af4cb8485db4a25ae46587f306/users/68f993e5f1a340b886c4f5da302d18cb/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.391045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 906/1811] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:08:15.395740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424a32c-4c09-439e-be41-5e68128e8c40 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.418579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6715f-4351-4836-ba8d-1e8a79bc6fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636c75af4cb8485db4a25ae46587f306, user_id=68f993e5f1a340b886c4f5da302d18cb, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.426623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6715f-4351-4836-ba8d-1e8a79bc6fb0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.464608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424a32c-4c09-439e-be41-5e68128e8c40 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.488778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 906/1812] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:15 2022] PUT /identity/v3/projects/636c75af4cb8485db4a25ae46587f306/users/68f993e5f1a340b886c4f5da302d18cb/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:15.499675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6715f-4351-4836-ba8d-1e8a79bc6fb0 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.500511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9bdb6-c2c3-4957-bf9d-962131f85c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.500511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9bdb6-c2c3-4957-bf9d-962131f85c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.500511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9bdb6-c2c3-4957-bf9d-962131f85c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.500511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9bdb6-c2c3-4957-bf9d-962131f85c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.507362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9bdb6-c2c3-4957-bf9d-962131f85c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.509294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9bdb6-c2c3-4957-bf9d-962131f85c88 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.516931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7da6715f-4351-4836-ba8d-1e8a79bc6fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:15.570826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 907/1813] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:15 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:15.573171 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09d7de-738b-42f0-a6f7-6f97f08ad1d4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.573742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09d7de-738b-42f0-a6f7-6f97f08ad1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.574226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09d7de-738b-42f0-a6f7-6f97f08ad1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.596304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6715f-4351-4836-ba8d-1e8a79bc6fb0 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.621020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ff09d7de-738b-42f0-a6f7-6f97f08ad1d4 None None] MFA Rules not processed for user `68f993e5f1a340b886c4f5da302d18cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:15.622284 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ff09d7de-738b-42f0-a6f7-6f97f08ad1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:15.664263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ca8e-1fe6-4b1c-baa8-9b16ae22a1f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.664931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ca8e-1fe6-4b1c-baa8-9b16ae22a1f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.665279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ca8e-1fe6-4b1c-baa8-9b16ae22a1f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.665985 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37ca8e-1fe6-4b1c-baa8-9b16ae22a1f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.668718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fb37ca8e-1fe6-4b1c-baa8-9b16ae22a1f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:15.677899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:15.716651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 908/1814] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:15.717919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09d7de-738b-42f0-a6f7-6f97f08ad1d4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.735821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:15.760530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ca8e-1fe6-4b1c-baa8-9b16ae22a1f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.762611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37ca8e-1fe6-4b1c-baa8-9b16ae22a1f1 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.782500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 907/1815] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:15.784248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ca8e-1fe6-4b1c-baa8-9b16ae22a1f1 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.817612 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09d7de-738b-42f0-a6f7-6f97f08ad1d4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.824286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1fc2e-93aa-414e-9097-7a062ff529ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.825653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1fc2e-93aa-414e-9097-7a062ff529ea admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.826148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1fc2e-93aa-414e-9097-7a062ff529ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.826630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1fc2e-93aa-414e-9097-7a062ff529ea admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.827581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1fc2e-93aa-414e-9097-7a062ff529ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.830105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1fc2e-93aa-414e-9097-7a062ff529ea admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.862432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 909/1816] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:15 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:15.864793 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1fc2e-93aa-414e-9097-7a062ff529ea admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.870801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37ca8e-1fe6-4b1c-baa8-9b16ae22a1f1 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.878841 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1fc2e-93aa-414e-9097-7a062ff529ea admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.879671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f980ecc-31ad-4c4a-ac74-eefa5da35ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.880549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f980ecc-31ad-4c4a-ac74-eefa5da35ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.881039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f980ecc-31ad-4c4a-ac74-eefa5da35ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.881492 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f980ecc-31ad-4c4a-ac74-eefa5da35ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.882364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f980ecc-31ad-4c4a-ac74-eefa5da35ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.884521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26367af-8f93-457e-bfcf-1827f748f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.885280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26367af-8f93-457e-bfcf-1827f748f6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.885541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f980ecc-31ad-4c4a-ac74-eefa5da35ef7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.885642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26367af-8f93-457e-bfcf-1827f748f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.886009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26367af-8f93-457e-bfcf-1827f748f6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.886854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26367af-8f93-457e-bfcf-1827f748f6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.888503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26367af-8f93-457e-bfcf-1827f748f6c5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.906197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 910/1817] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:15.907851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26367af-8f93-457e-bfcf-1827f748f6c5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.921821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26367af-8f93-457e-bfcf-1827f748f6c5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:15.926772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 908/1818] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:15 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:15.931218 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f980ecc-31ad-4c4a-ac74-eefa5da35ef7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.933616 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533105-3296-4d04-8b3e-dd3869cfebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:15.934422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533105-3296-4d04-8b3e-dd3869cfebfe admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:15.934729 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533105-3296-4d04-8b3e-dd3869cfebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:15.935008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533105-3296-4d04-8b3e-dd3869cfebfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:15.935916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533105-3296-4d04-8b3e-dd3869cfebfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:15.937523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533105-3296-4d04-8b3e-dd3869cfebfe admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:15.960203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 911/1819] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:15.965799 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533105-3296-4d04-8b3e-dd3869cfebfe admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:15.983556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533105-3296-4d04-8b3e-dd3869cfebfe admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:16.018511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f980ecc-31ad-4c4a-ac74-eefa5da35ef7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:16.027484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed937f2-0b57-4725-9a84-2dd43f82b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:16.028316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed937f2-0b57-4725-9a84-2dd43f82b5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.028549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed937f2-0b57-4725-9a84-2dd43f82b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.028876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed937f2-0b57-4725-9a84-2dd43f82b5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.029589 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed937f2-0b57-4725-9a84-2dd43f82b5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:16.033553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed937f2-0b57-4725-9a84-2dd43f82b5d3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:16.061749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 909/1820] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:15 2022] POST /identity/v3/users => generated 298 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:16.066626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed937f2-0b57-4725-9a84-2dd43f82b5d3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:16.066932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27f67f-a251-4a07-a800-f000ae5eacf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:16.068299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27f67f-a251-4a07-a800-f000ae5eacf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.068721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27f67f-a251-4a07-a800-f000ae5eacf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.069079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27f67f-a251-4a07-a800-f000ae5eacf7 admin admin] PATH_INFO: `/v3/projects/5e8cda5fc6e54d03b25361502eeffc94/users/16ffa16c98164c2399fcd3135bedb3cb/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.077840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed937f2-0b57-4725-9a84-2dd43f82b5d3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:16.084513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba1e46-5a5b-4beb-9acc-3b1625ad6a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:16.085904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba1e46-5a5b-4beb-9acc-3b1625ad6a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.086034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba1e46-5a5b-4beb-9acc-3b1625ad6a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.086304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba1e46-5a5b-4beb-9acc-3b1625ad6a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.087333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba1e46-5a5b-4beb-9acc-3b1625ad6a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:16.089553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba1e46-5a5b-4beb-9acc-3b1625ad6a52 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:16.091915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27f67f-a251-4a07-a800-f000ae5eacf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8cda5fc6e54d03b25361502eeffc94, user_id=16ffa16c98164c2399fcd3135bedb3cb, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:16.096765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27f67f-a251-4a07-a800-f000ae5eacf7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:16.108935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 910/1821] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:16.110093 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba1e46-5a5b-4beb-9acc-3b1625ad6a52 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:16.116541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 912/1822] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:15 2022] PUT /identity/v3/projects/5e8cda5fc6e54d03b25361502eeffc94/users/16ffa16c98164c2399fcd3135bedb3cb/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:16.121162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba1e46-5a5b-4beb-9acc-3b1625ad6a52 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:16.132656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dc440-d320-466d-993d-f36e1775fa08 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.133207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dc440-d320-466d-993d-f36e1775fa08 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.133672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dc440-d320-466d-993d-f36e1775fa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.176174 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a38dc440-d320-466d-993d-f36e1775fa08 None None] MFA Rules not processed for user `16ffa16c98164c2399fcd3135bedb3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:16.177429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a38dc440-d320-466d-993d-f36e1775fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:16.206028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:16.221401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c5017-3bb2-4d1e-8337-f345e743d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:16.222420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5017-3bb2-4d1e-8337-f345e743d99a admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.222745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5017-3bb2-4d1e-8337-f345e743d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.223007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5017-3bb2-4d1e-8337-f345e743d99a admin admin] PATH_INFO: `/v3/projects/2350f25953d24d7ea6f308fb865b0398/users/d0cd0c866fef4c4b9f542b64f5ef53bf/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.233707 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:16.242972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c5017-3bb2-4d1e-8337-f345e743d99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2350f25953d24d7ea6f308fb865b0398, user_id=d0cd0c866fef4c4b9f542b64f5ef53bf, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:16.246438 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c5017-3bb2-4d1e-8337-f345e743d99a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:16.293790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 911/1823] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:16 2022] PUT /identity/v3/projects/2350f25953d24d7ea6f308fb865b0398/users/d0cd0c866fef4c4b9f542b64f5ef53bf/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:16.295678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c5017-3bb2-4d1e-8337-f345e743d99a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:16.374430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 913/1824] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:16.375552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dc440-d320-466d-993d-f36e1775fa08 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:16.378894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a38dc440-d320-466d-993d-f36e1775fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:16.396048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c5017-3bb2-4d1e-8337-f345e743d99a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:16.423459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d9ca-94fe-45f6-811f-6d0c7ab07a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:16.427022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d9ca-94fe-45f6-811f-6d0c7ab07a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.427318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d9ca-94fe-45f6-811f-6d0c7ab07a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.427592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d9ca-94fe-45f6-811f-6d0c7ab07a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.429467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d9ca-94fe-45f6-811f-6d0c7ab07a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:16.433150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d9ca-94fe-45f6-811f-6d0c7ab07a71 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:16.462005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 912/1825] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:16.466535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d9ca-94fe-45f6-811f-6d0c7ab07a71 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:16.500459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d9ca-94fe-45f6-811f-6d0c7ab07a71 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:16.511700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e346b-1261-4a1a-9ce8-f37b6118d717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:16.513058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e346b-1261-4a1a-9ce8-f37b6118d717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.513518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e346b-1261-4a1a-9ce8-f37b6118d717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.513899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e346b-1261-4a1a-9ce8-f37b6118d717 admin admin] PATH_INFO: `/v3/projects/2350f25953d24d7ea6f308fb865b0398/users/d0cd0c866fef4c4b9f542b64f5ef53bf/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.517885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e346b-1261-4a1a-9ce8-f37b6118d717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2350f25953d24d7ea6f308fb865b0398, user_id=d0cd0c866fef4c4b9f542b64f5ef53bf, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:16.521261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e346b-1261-4a1a-9ce8-f37b6118d717 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:16.541459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 913/1826] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:16 2022] PUT /identity/v3/projects/2350f25953d24d7ea6f308fb865b0398/users/d0cd0c866fef4c4b9f542b64f5ef53bf/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:16.553700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9e53-7e34-4550-a214-710a8f23a21d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.554426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9e53-7e34-4550-a214-710a8f23a21d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.555175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9e53-7e34-4550-a214-710a8f23a21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.560289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dc440-d320-466d-993d-f36e1775fa08 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:16.644783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c9ed9e53-7e34-4550-a214-710a8f23a21d None None] MFA Rules not processed for user `d0cd0c866fef4c4b9f542b64f5ef53bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:16.644783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c9ed9e53-7e34-4550-a214-710a8f23a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:16.645031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfff126-3ad4-4e0e-b4cc-abb5c594be8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a5d7aee47e43e9904a93c6ce3bb412', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:16.645031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfff126-3ad4-4e0e-b4cc-abb5c594be8a service glance] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.645031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfff126-3ad4-4e0e-b4cc-abb5c594be8a service glance] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.645031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfff126-3ad4-4e0e-b4cc-abb5c594be8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.723040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfff126-3ad4-4e0e-b4cc-abb5c594be8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:16.725041 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfff126-3ad4-4e0e-b4cc-abb5c594be8a service glance] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:16.735632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 914/1827] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:08:16.743289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 914/1828] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:16.749045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed9e53-7e34-4550-a214-710a8f23a21d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:16.752296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c9ed9e53-7e34-4550-a214-710a8f23a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:16.811942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:16.826594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed9e53-7e34-4550-a214-710a8f23a21d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:16.832693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b056b-7a13-496b-b04d-fd820ad40974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:16.833535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b056b-7a13-496b-b04d-fd820ad40974 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.834028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b056b-7a13-496b-b04d-fd820ad40974 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.834260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b056b-7a13-496b-b04d-fd820ad40974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.846569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b056b-7a13-496b-b04d-fd820ad40974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:16.848617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b056b-7a13-496b-b04d-fd820ad40974 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:16.859185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 915/1829] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:16.950872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfff126-3ad4-4e0e-b4cc-abb5c594be8a service glance] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:16.960529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfff126-3ad4-4e0e-b4cc-abb5c594be8a service glance] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:16.964333 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3874f8c-3394-4650-8ee8-e9ff3a225b10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:16.965191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3874f8c-3394-4650-8ee8-e9ff3a225b10 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:16.965476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3874f8c-3394-4650-8ee8-e9ff3a225b10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:16.965751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3874f8c-3394-4650-8ee8-e9ff3a225b10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:16.994395 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:17.027091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3874f8c-3394-4650-8ee8-e9ff3a225b10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:17.028526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3874f8c-3394-4650-8ee8-e9ff3a225b10 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:17.038991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 915/1830] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:17.323403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b056b-7a13-496b-b04d-fd820ad40974 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:17.398295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b056b-7a13-496b-b04d-fd820ad40974 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:17.402794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:17.403662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:17.403938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:17.404206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] PATH_INFO: `/v3/users/68f993e5f1a340b886c4f5da302d18cb` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:17.405443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f993e5f1a340b886c4f5da302d18cb)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:17.407432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:17.454888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f993e5f1a340b886c4f5da302d18cb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:17.455561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f993e5f1a340b886c4f5da302d18cb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:17.462780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f993e5f1a340b886c4f5da302d18cb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:17.463477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f993e5f1a340b886c4f5da302d18cb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:17.475796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f993e5f1a340b886c4f5da302d18cb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:17.491873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 916/1831] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:17 2022] DELETE /identity/v3/users/68f993e5f1a340b886c4f5da302d18cb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:17.496529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa034-5113-4586-a38f-2280dc7f7c53 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:17.496824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa034-5113-4586-a38f-2280dc7f7c53 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:17.497108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa034-5113-4586-a38f-2280dc7f7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:17.525242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b72aa034-5113-4586-a38f-2280dc7f7c53 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:17.527873 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b72aa034-5113-4586-a38f-2280dc7f7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:17.602020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 916/1832] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:17.611544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:17.612955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:17.675835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b081fa-e578-410e-aaef-7f189ddff1c6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:17.679426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cdca8-0948-4b96-b887-ff5c6b1b62ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:17.680076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cdca8-0948-4b96-b887-ff5c6b1b62ef service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:17.680356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cdca8-0948-4b96-b887-ff5c6b1b62ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:17.680670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cdca8-0948-4b96-b887-ff5c6b1b62ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:17.691922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cdca8-0948-4b96-b887-ff5c6b1b62ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:17.693367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cdca8-0948-4b96-b887-ff5c6b1b62ef service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:17.712324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 917/1833] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:18.068350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aa034-5113-4586-a38f-2280dc7f7c53 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:18.069894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b72aa034-5113-4586-a38f-2280dc7f7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:18.083427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aa034-5113-4586-a38f-2280dc7f7c53 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:18.102359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:18.103283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:18.103592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:18.103904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] PATH_INFO: `/v3/projects/636c75af4cb8485db4a25ae46587f306` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:18.105267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=636c75af4cb8485db4a25ae46587f306)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:18.107299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:18.162919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636c75af4cb8485db4a25ae46587f306', 'request_id': 'req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.176145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636c75af4cb8485db4a25ae46587f306', 'request_id': 'req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.183009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636c75af4cb8485db4a25ae46587f306', 'request_id': 'req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.193778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] The token cache is being invalidate because project 636c75af4cb8485db4a25ae46587f306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:18.194059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.194748 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.196524 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 917/1834] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:18 2022] DELETE /identity/v3/projects/636c75af4cb8485db4a25ae46587f306 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:18.201664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cdca8-0948-4b96-b887-ff5c6b1b62ef service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:18.212612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cdca8-0948-4b96-b887-ff5c6b1b62ef service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:18.216196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:18.277847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:18.277847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:18.277847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:18.277847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] PATH_INFO: `/v3/users/d0cd0c866fef4c4b9f542b64f5ef53bf` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:18.278190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0cd0c866fef4c4b9f542b64f5ef53bf)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:18.279110 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:18.328026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0cd0c866fef4c4b9f542b64f5ef53bf'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.328727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0cd0c866fef4c4b9f542b64f5ef53bf'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.335581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0cd0c866fef4c4b9f542b64f5ef53bf'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.336208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0cd0c866fef4c4b9f542b64f5ef53bf'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.348523 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b11e9298-ab98-4eb4-85ba-4faebb59309f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0cd0c866fef4c4b9f542b64f5ef53bf'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.367285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 918/1835] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:18 2022] DELETE /identity/v3/users/d0cd0c866fef4c4b9f542b64f5ef53bf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:18.680502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:18.682021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:18.706312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8d3cc-1d2f-4205-bc77-f2e457e12c41 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:18.764867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:18.776348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:18.777226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:18.777867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:18.778106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] PATH_INFO: `/v3/projects/2350f25953d24d7ea6f308fb865b0398` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:18.779359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2350f25953d24d7ea6f308fb865b0398)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:18.781362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:18.854178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2350f25953d24d7ea6f308fb865b0398', 'request_id': 'req-7518be68-17e0-4d20-9a0f-e0a521e73f1a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.862547 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2350f25953d24d7ea6f308fb865b0398', 'request_id': 'req-7518be68-17e0-4d20-9a0f-e0a521e73f1a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.870006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2350f25953d24d7ea6f308fb865b0398', 'request_id': 'req-7518be68-17e0-4d20-9a0f-e0a521e73f1a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.895567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] The token cache is being invalidate because project 2350f25953d24d7ea6f308fb865b0398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:18.895567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.896056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7518be68-17e0-4d20-9a0f-e0a521e73f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:18.897775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 918/1836] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:18 2022] DELETE /identity/v3/projects/2350f25953d24d7ea6f308fb865b0398 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:18.902787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d83dc-6967-4798-af3f-533aca4d8c16 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:18.903082 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d83dc-6967-4798-af3f-533aca4d8c16 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:18.903356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d83dc-6967-4798-af3f-533aca4d8c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:18.921485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d98d83dc-6967-4798-af3f-533aca4d8c16 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:18.923431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d98d83dc-6967-4798-af3f-533aca4d8c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:18.991077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 919/1837] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:19.000198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d79e-4eda-4373-8cf5-aaf86287d858 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:19.000492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d79e-4eda-4373-8cf5-aaf86287d858 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:19.000783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d79e-4eda-4373-8cf5-aaf86287d858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:19.019344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7eb8d79e-4eda-4373-8cf5-aaf86287d858 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:19.020497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7eb8d79e-4eda-4373-8cf5-aaf86287d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:19.028999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 919/1838] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:19.035601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d83dc-6967-4798-af3f-533aca4d8c16 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:19.045376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d83dc-6967-4798-af3f-533aca4d8c16 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:19.051783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ad66b-65d8-493f-ac74-5b789f638cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:19.052441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad66b-65d8-493f-ac74-5b789f638cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:19.052718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad66b-65d8-493f-ac74-5b789f638cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:19.053000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad66b-65d8-493f-ac74-5b789f638cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:19.053722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ad66b-65d8-493f-ac74-5b789f638cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:19.054033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ad66b-65d8-493f-ac74-5b789f638cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:19.055667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ad66b-65d8-493f-ac74-5b789f638cd7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:19.067275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 920/1839] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:08:19.071762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d79e-4eda-4373-8cf5-aaf86287d858 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:19.081509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d79e-4eda-4373-8cf5-aaf86287d858 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:19.086226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8840d5-f70d-488d-9542-2e193c4a3fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:19.086919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8840d5-f70d-488d-9542-2e193c4a3fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:19.087208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8840d5-f70d-488d-9542-2e193c4a3fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:19.087488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8840d5-f70d-488d-9542-2e193c4a3fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:19.088182 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8840d5-f70d-488d-9542-2e193c4a3fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:19.090115 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8840d5-f70d-488d-9542-2e193c4a3fa2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:19.118585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 920/1840] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:19 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:19.122588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ad66b-65d8-493f-ac74-5b789f638cd7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:19.132527 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ad66b-65d8-493f-ac74-5b789f638cd7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:19.141966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:19.194377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b70cb2-095c-4b5c-847b-d97c17e2a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:19.195087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b70cb2-095c-4b5c-847b-d97c17e2a96d admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:19.195369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b70cb2-095c-4b5c-847b-d97c17e2a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:19.195641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b70cb2-095c-4b5c-847b-d97c17e2a96d admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:19.196314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b70cb2-095c-4b5c-847b-d97c17e2a96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:19.198217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b70cb2-095c-4b5c-847b-d97c17e2a96d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:19.218614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 921/1841] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:19 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:19.224522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8840d5-f70d-488d-9542-2e193c4a3fa2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:19.236232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8840d5-f70d-488d-9542-2e193c4a3fa2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:19.241038 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb6b5-204c-4539-b8fc-c828d338e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:19.241700 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb6b5-204c-4539-b8fc-c828d338e947 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:19.241986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb6b5-204c-4539-b8fc-c828d338e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:19.242265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb6b5-204c-4539-b8fc-c828d338e947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:19.243033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfb6b5-204c-4539-b8fc-c828d338e947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:19.244635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfb6b5-204c-4539-b8fc-c828d338e947 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:19.259845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 921/1842] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:19.263797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b70cb2-095c-4b5c-847b-d97c17e2a96d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:19.274164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b70cb2-095c-4b5c-847b-d97c17e2a96d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:19.278678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b581ad-ed97-47ef-b8f7-f467ac7d8ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:19.279381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b581ad-ed97-47ef-b8f7-f467ac7d8ede admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:19.279693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b581ad-ed97-47ef-b8f7-f467ac7d8ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:19.279969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b581ad-ed97-47ef-b8f7-f467ac7d8ede admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:19.280773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b581ad-ed97-47ef-b8f7-f467ac7d8ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:19.282379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b581ad-ed97-47ef-b8f7-f467ac7d8ede admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:19.293302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 922/1843] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:08:19.298211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb6b5-204c-4539-b8fc-c828d338e947 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:19.308506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb6b5-204c-4539-b8fc-c828d338e947 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:19.313896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef33558-ce44-4080-9ce2-9695092004a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:19.314804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef33558-ce44-4080-9ce2-9695092004a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:19.315202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef33558-ce44-4080-9ce2-9695092004a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:19.315478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef33558-ce44-4080-9ce2-9695092004a5 admin admin] PATH_INFO: `/v3/projects/003506bc46d442929985e0fd761ba9cb/users/d19bc538d7d44766b1948862a16b359b/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:19.330439 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef33558-ce44-4080-9ce2-9695092004a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003506bc46d442929985e0fd761ba9cb, user_id=d19bc538d7d44766b1948862a16b359b, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:19.333096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef33558-ce44-4080-9ce2-9695092004a5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:19.345489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 922/1844] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:19 2022] PUT /identity/v3/projects/003506bc46d442929985e0fd761ba9cb/users/d19bc538d7d44766b1948862a16b359b/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:19.355922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59179c-bad7-42f5-a657-aef8d99028da None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:19.356626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59179c-bad7-42f5-a657-aef8d99028da None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:19.356626 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59179c-bad7-42f5-a657-aef8d99028da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:19.386716 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8a59179c-bad7-42f5-a657-aef8d99028da None None] MFA Rules not processed for user `d19bc538d7d44766b1948862a16b359b`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:19.388098 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8a59179c-bad7-42f5-a657-aef8d99028da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:19.505118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 923/1845] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:19.508063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef33558-ce44-4080-9ce2-9695092004a5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:19.667477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef33558-ce44-4080-9ce2-9695092004a5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:19.681690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f55fd7-e087-4aa4-ac34-b480e64d23aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:19.682365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55fd7-e087-4aa4-ac34-b480e64d23aa admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:19.682678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55fd7-e087-4aa4-ac34-b480e64d23aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:19.683278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f55fd7-e087-4aa4-ac34-b480e64d23aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:19.683998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f55fd7-e087-4aa4-ac34-b480e64d23aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:19.687586 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f55fd7-e087-4aa4-ac34-b480e64d23aa admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:19.736903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 923/1846] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:19 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:19.738149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59179c-bad7-42f5-a657-aef8d99028da None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:19.756856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59179c-bad7-42f5-a657-aef8d99028da None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:19.949544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9f5af-e579-4f5a-abde-e3efd59dfd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:19.950255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9f5af-e579-4f5a-abde-e3efd59dfd83 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:19.950541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9f5af-e579-4f5a-abde-e3efd59dfd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:19.950864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9f5af-e579-4f5a-abde-e3efd59dfd83 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:19.951573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9f5af-e579-4f5a-abde-e3efd59dfd83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:19.953559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9f5af-e579-4f5a-abde-e3efd59dfd83 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:20.013167 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 924/1847] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:19 2022] POST /identity/v3/users => generated 298 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:20.014178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f55fd7-e087-4aa4-ac34-b480e64d23aa admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:20.021480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:20.050090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f55fd7-e087-4aa4-ac34-b480e64d23aa admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:20.069820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164122db-edf5-4855-88c8-de9d2708ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:20.070506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164122db-edf5-4855-88c8-de9d2708ecf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:20.070822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164122db-edf5-4855-88c8-de9d2708ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:20.071426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164122db-edf5-4855-88c8-de9d2708ecf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:20.071845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164122db-edf5-4855-88c8-de9d2708ecf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:20.073471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164122db-edf5-4855-88c8-de9d2708ecf0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:20.101325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 924/1848] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:20.106332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9f5af-e579-4f5a-abde-e3efd59dfd83 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:20.124014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9f5af-e579-4f5a-abde-e3efd59dfd83 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:20.143364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cadd26-ebcd-429b-b732-8da125e8121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:20.145604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cadd26-ebcd-429b-b732-8da125e8121b admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:20.145899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cadd26-ebcd-429b-b732-8da125e8121b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:20.146180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cadd26-ebcd-429b-b732-8da125e8121b admin admin] PATH_INFO: `/v3/projects/6ac4fe3a3eea4d9388f93e4610781b9c/users/97fb63eabc3c48e79f844873a64e8b96/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:20.173150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:20.225616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cadd26-ebcd-429b-b732-8da125e8121b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac4fe3a3eea4d9388f93e4610781b9c, user_id=97fb63eabc3c48e79f844873a64e8b96, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:20.229347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cadd26-ebcd-429b-b732-8da125e8121b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:20.279531 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 925/1849] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:20 2022] PUT /identity/v3/projects/6ac4fe3a3eea4d9388f93e4610781b9c/users/97fb63eabc3c48e79f844873a64e8b96/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:20.287145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164122db-edf5-4855-88c8-de9d2708ecf0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:20.300640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164122db-edf5-4855-88c8-de9d2708ecf0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:20.431683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e227e62-0362-46ff-8634-7f197d587dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:20.439870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e227e62-0362-46ff-8634-7f197d587dac admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:20.440364 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e227e62-0362-46ff-8634-7f197d587dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:20.440716 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e227e62-0362-46ff-8634-7f197d587dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:20.441719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e227e62-0362-46ff-8634-7f197d587dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:20.443678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e227e62-0362-46ff-8634-7f197d587dac admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:20.464218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 925/1850] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:20.466100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cadd26-ebcd-429b-b732-8da125e8121b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:20.480493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cadd26-ebcd-429b-b732-8da125e8121b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:20.489519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78365db7-f42c-4ab0-a3fc-0ee027b0085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:20.492380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78365db7-f42c-4ab0-a3fc-0ee027b0085b admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:20.492975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78365db7-f42c-4ab0-a3fc-0ee027b0085b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:20.493863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78365db7-f42c-4ab0-a3fc-0ee027b0085b admin admin] PATH_INFO: `/v3/projects/6ac4fe3a3eea4d9388f93e4610781b9c/users/97fb63eabc3c48e79f844873a64e8b96/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:20.497471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78365db7-f42c-4ab0-a3fc-0ee027b0085b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac4fe3a3eea4d9388f93e4610781b9c, user_id=97fb63eabc3c48e79f844873a64e8b96, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:20.503062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78365db7-f42c-4ab0-a3fc-0ee027b0085b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:20.550535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 926/1851] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:20 2022] PUT /identity/v3/projects/6ac4fe3a3eea4d9388f93e4610781b9c/users/97fb63eabc3c48e79f844873a64e8b96/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:20.552029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6950d-72a3-49a7-8870-ff34042e075d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:20.553003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6950d-72a3-49a7-8870-ff34042e075d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:20.553798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6950d-72a3-49a7-8870-ff34042e075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:20.587734 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a6f6950d-72a3-49a7-8870-ff34042e075d None None] MFA Rules not processed for user `97fb63eabc3c48e79f844873a64e8b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:20.588967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a6f6950d-72a3-49a7-8870-ff34042e075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:20.715446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 926/1852] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:08:20.726386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78365db7-f42c-4ab0-a3fc-0ee027b0085b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:20.728363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-78365db7-f42c-4ab0-a3fc-0ee027b0085b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:20.834439 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78365db7-f42c-4ab0-a3fc-0ee027b0085b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:20.839730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb07c97-b9b2-4f7f-ad42-450280ede79a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:20.840854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb07c97-b9b2-4f7f-ad42-450280ede79a service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:20.841140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb07c97-b9b2-4f7f-ad42-450280ede79a service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:20.841419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb07c97-b9b2-4f7f-ad42-450280ede79a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:20.926313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb07c97-b9b2-4f7f-ad42-450280ede79a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:20.927816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb07c97-b9b2-4f7f-ad42-450280ede79a service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:20.937939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 927/1853] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:08:22.983839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6950d-72a3-49a7-8870-ff34042e075d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:22.985913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a6f6950d-72a3-49a7-8870-ff34042e075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:23.018920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6950d-72a3-49a7-8870-ff34042e075d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:23.023595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d334578-9c56-47eb-8fea-8cba32972fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:23.024096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d334578-9c56-47eb-8fea-8cba32972fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:23.024382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d334578-9c56-47eb-8fea-8cba32972fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:23.024656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d334578-9c56-47eb-8fea-8cba32972fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:23.026816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2d334578-9c56-47eb-8fea-8cba32972fe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:23.126151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d334578-9c56-47eb-8fea-8cba32972fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:23.127884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d334578-9c56-47eb-8fea-8cba32972fe4 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:23.138146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 927/1854] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:23.270320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb07c97-b9b2-4f7f-ad42-450280ede79a service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:23.272820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9bb07c97-b9b2-4f7f-ad42-450280ede79a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:23.370139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb07c97-b9b2-4f7f-ad42-450280ede79a service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:23.377804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:23.379026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:23.379264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:23.379545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] PATH_INFO: `/v3/users/648f64fb0afb461dae438ce997bb747b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:23.381030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=648f64fb0afb461dae438ce997bb747b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:23.383619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:23.432654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:23.453203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648f64fb0afb461dae438ce997bb747b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:23.454518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648f64fb0afb461dae438ce997bb747b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:23.469097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648f64fb0afb461dae438ce997bb747b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:23.469847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648f64fb0afb461dae438ce997bb747b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:23.491053 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648f64fb0afb461dae438ce997bb747b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:23.508824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 928/1855] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:23 2022] DELETE /identity/v3/users/648f64fb0afb461dae438ce997bb747b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:23.515646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0d61-366c-4538-a411-a9c34b91f46e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:23.516664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0d61-366c-4538-a411-a9c34b91f46e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:23.517311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0d61-366c-4538-a411-a9c34b91f46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:23.536824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7abd0d61-366c-4538-a411-a9c34b91f46e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:23.538014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7abd0d61-366c-4538-a411-a9c34b91f46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:23.543299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:23.604185 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 928/1856] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:08:23.614783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:23.616227 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:23.696003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0f03e-ebac-416d-9557-ec106102d18b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:23.701151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c849df5-d534-4e1b-9f63-2bf6235c228e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:23.702267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c849df5-d534-4e1b-9f63-2bf6235c228e service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:23.702621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c849df5-d534-4e1b-9f63-2bf6235c228e service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:23.703033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c849df5-d534-4e1b-9f63-2bf6235c228e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:23.722631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c849df5-d534-4e1b-9f63-2bf6235c228e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:23.722631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c849df5-d534-4e1b-9f63-2bf6235c228e service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:23.736675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 929/1857] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:08:23.863476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f16b9e-b771-4988-a406-25ba32b202ca None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:23.863770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f16b9e-b771-4988-a406-25ba32b202ca None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:23.864223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f16b9e-b771-4988-a406-25ba32b202ca None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:23.865653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 929/1858] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 18:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:08:23.880561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201181f1-f08b-4754-8d0b-af78127f11e6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:23.880880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201181f1-f08b-4754-8d0b-af78127f11e6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:23.881155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201181f1-f08b-4754-8d0b-af78127f11e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:23.906447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-201181f1-f08b-4754-8d0b-af78127f11e6 None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:23.907891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-201181f1-f08b-4754-8d0b-af78127f11e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:24.013529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 930/1859] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 18:08:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:08:24.042118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f16b9e-b771-4988-a406-25ba32b202ca None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:24.044015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d4f16b9e-b771-4988-a406-25ba32b202ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:24.072925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f16b9e-b771-4988-a406-25ba32b202ca None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:24.081084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ccd1a-e837-4de1-a88d-f91b27472705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:24.081788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ccd1a-e837-4de1-a88d-f91b27472705 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:24.082080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ccd1a-e837-4de1-a88d-f91b27472705 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:24.082358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ccd1a-e837-4de1-a88d-f91b27472705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:24.098742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ccd1a-e837-4de1-a88d-f91b27472705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:24.101056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ccd1a-e837-4de1-a88d-f91b27472705 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:24.121006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 930/1860] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:24.137433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201181f1-f08b-4754-8d0b-af78127f11e6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:24.138977 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-201181f1-f08b-4754-8d0b-af78127f11e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:24.154997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201181f1-f08b-4754-8d0b-af78127f11e6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:24.163288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:24.164412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:24.164699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:24.164981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] PATH_INFO: `/v3/projects/07a15b8b2fb3446a988e1509d7c058db` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:24.167819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a15b8b2fb3446a988e1509d7c058db)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:24.170095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:24.237459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:24.251774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a15b8b2fb3446a988e1509d7c058db', 'request_id': 'req-eb5e2444-302f-4faa-80b2-689c0ccd821b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:24.260592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a15b8b2fb3446a988e1509d7c058db', 'request_id': 'req-eb5e2444-302f-4faa-80b2-689c0ccd821b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:24.270042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a15b8b2fb3446a988e1509d7c058db', 'request_id': 'req-eb5e2444-302f-4faa-80b2-689c0ccd821b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:24.287778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] The token cache is being invalidate because project 07a15b8b2fb3446a988e1509d7c058db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:24.288431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:24.289026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:24.293786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 931/1861] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:24 2022] DELETE /identity/v3/projects/07a15b8b2fb3446a988e1509d7c058db => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:24.295522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ccd1a-e837-4de1-a88d-f91b27472705 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:24.310160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ccd1a-e837-4de1-a88d-f91b27472705 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:24.392228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:24.393117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:24.393480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:24.393826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] PATH_INFO: `/v3/users/fea8eda41eda442e9010cc35d4841ae7` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:24.395107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea8eda41eda442e9010cc35d4841ae7)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:24.397083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:24.468618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea8eda41eda442e9010cc35d4841ae7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:24.481532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea8eda41eda442e9010cc35d4841ae7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:24.482745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea8eda41eda442e9010cc35d4841ae7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:24.483515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea8eda41eda442e9010cc35d4841ae7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:24.542479 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea8eda41eda442e9010cc35d4841ae7'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:24.585662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 931/1862] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:24 2022] DELETE /identity/v3/users/fea8eda41eda442e9010cc35d4841ae7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:25.746586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:25.748046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:25.831124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:25.832765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:25.883511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:25.923299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e2444-302f-4faa-80b2-689c0ccd821b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:26.032416 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6004d1c-02c2-4d0d-b65a-51c298b33c9c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:26.033171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b28f35-d64d-4411-ab80-a456bf4e61e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:26.034069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28f35-d64d-4411-ab80-a456bf4e61e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.034586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28f35-d64d-4411-ab80-a456bf4e61e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.034989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28f35-d64d-4411-ab80-a456bf4e61e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.039444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-60b28f35-d64d-4411-ab80-a456bf4e61e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:26.043677 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:26.046990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.048715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.049144 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] PATH_INFO: `/v3/projects/0e54a7fcdd884661ac02e238baa3e714` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.053990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e54a7fcdd884661ac02e238baa3e714)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:26.064839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:26.180308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e54a7fcdd884661ac02e238baa3e714', 'request_id': 'req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:26.199489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e54a7fcdd884661ac02e238baa3e714', 'request_id': 'req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:26.220981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e54a7fcdd884661ac02e238baa3e714', 'request_id': 'req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:26.236330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b28f35-d64d-4411-ab80-a456bf4e61e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:26.237801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b28f35-d64d-4411-ab80-a456bf4e61e5 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:26.242791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] The token cache is being invalidate because project 0e54a7fcdd884661ac02e238baa3e714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:26.243564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:26.243859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2d7c12e6-f1d7-4dc8-9cdf-36ca0b00e969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:26.245696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 932/1863] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:25 2022] DELETE /identity/v3/projects/0e54a7fcdd884661ac02e238baa3e714 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:26.251797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7da2d1-ccb0-4375-9899-c228439ca002 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.251943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7da2d1-ccb0-4375-9899-c228439ca002 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.252169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7da2d1-ccb0-4375-9899-c228439ca002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.284836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-dd7da2d1-ccb0-4375-9899-c228439ca002 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:26.286282 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dd7da2d1-ccb0-4375-9899-c228439ca002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:26.292167 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 932/1864] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:26.305237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b28f35-d64d-4411-ab80-a456bf4e61e5 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:26.306891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-60b28f35-d64d-4411-ab80-a456bf4e61e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:26.335836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b28f35-d64d-4411-ab80-a456bf4e61e5 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:26.404867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 933/1865] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:26.405090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:26.412568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33775b16-a01a-4dfa-8850-226032b34add None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.412916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33775b16-a01a-4dfa-8850-226032b34add None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.413878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33775b16-a01a-4dfa-8850-226032b34add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.448433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-33775b16-a01a-4dfa-8850-226032b34add None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:26.452339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-33775b16-a01a-4dfa-8850-226032b34add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:26.465226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 934/1866] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:26.467854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33775b16-a01a-4dfa-8850-226032b34add None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:26.486789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:26.487819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.487994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.488276 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] PATH_INFO: `/v3/users/89063e6ef030461eaed223b2ac0e0c84` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.489553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89063e6ef030461eaed223b2ac0e0c84)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:26.489779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33775b16-a01a-4dfa-8850-226032b34add None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:26.491736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:26.501469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508aeda-bfdb-415e-867a-a2842fadfacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:26.502306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508aeda-bfdb-415e-867a-a2842fadfacc admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.502593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508aeda-bfdb-415e-867a-a2842fadfacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.503025 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508aeda-bfdb-415e-867a-a2842fadfacc admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.503901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508aeda-bfdb-415e-867a-a2842fadfacc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:26.504213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508aeda-bfdb-415e-867a-a2842fadfacc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:26.505862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508aeda-bfdb-415e-867a-a2842fadfacc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:26.528304 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 935/1867] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:08:26.532283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508aeda-bfdb-415e-867a-a2842fadfacc admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:26.544236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508aeda-bfdb-415e-867a-a2842fadfacc admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:26.551998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510e0fe-d0ca-40cf-80fb-d07d148fc327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:26.553374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510e0fe-d0ca-40cf-80fb-d07d148fc327 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.554084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510e0fe-d0ca-40cf-80fb-d07d148fc327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.554741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510e0fe-d0ca-40cf-80fb-d07d148fc327 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.556098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510e0fe-d0ca-40cf-80fb-d07d148fc327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:26.558347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510e0fe-d0ca-40cf-80fb-d07d148fc327 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:26.600259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89063e6ef030461eaed223b2ac0e0c84'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:26.601490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89063e6ef030461eaed223b2ac0e0c84'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:26.611397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 936/1868] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:26 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:26.613008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510e0fe-d0ca-40cf-80fb-d07d148fc327 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:26.615127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4510e0fe-d0ca-40cf-80fb-d07d148fc327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:26.620222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89063e6ef030461eaed223b2ac0e0c84'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:26.621973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89063e6ef030461eaed223b2ac0e0c84'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:26.628434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:26.668045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ca3dcc62-7a83-422f-a4f4-3b8be4e8daf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89063e6ef030461eaed223b2ac0e0c84'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:26.696108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 933/1869] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:26 2022] DELETE /identity/v3/users/89063e6ef030461eaed223b2ac0e0c84 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:26.701678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e830-7697-4ea2-8324-a8b5bde859f2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.702644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e830-7697-4ea2-8324-a8b5bde859f2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.704747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e830-7697-4ea2-8324-a8b5bde859f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.720942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510e0fe-d0ca-40cf-80fb-d07d148fc327 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:26.732284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3f39e830-7697-4ea2-8324-a8b5bde859f2 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:26.733696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3f39e830-7697-4ea2-8324-a8b5bde859f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:26.823208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 934/1870] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:08:26.833287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39e830-7697-4ea2-8324-a8b5bde859f2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:26.835584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3f39e830-7697-4ea2-8324-a8b5bde859f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:26.849841 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e75f0-6235-49fd-ac97-c21b47d273fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:26.852992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e75f0-6235-49fd-ac97-c21b47d273fe admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.853158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e75f0-6235-49fd-ac97-c21b47d273fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.853448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e75f0-6235-49fd-ac97-c21b47d273fe admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.854172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e75f0-6235-49fd-ac97-c21b47d273fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:26.860866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e75f0-6235-49fd-ac97-c21b47d273fe admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:26.900549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 937/1871] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:26 2022] POST /identity/v3/users => generated 287 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:26.904226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e75f0-6235-49fd-ac97-c21b47d273fe admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:26.917133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e75f0-6235-49fd-ac97-c21b47d273fe admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:26.943774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39e830-7697-4ea2-8324-a8b5bde859f2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:26.947127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61374f8-fb46-413f-9b21-96c19e952422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:26.947833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61374f8-fb46-413f-9b21-96c19e952422 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.948130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61374f8-fb46-413f-9b21-96c19e952422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.948441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61374f8-fb46-413f-9b21-96c19e952422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.949220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ec60c-acbd-42e6-86cb-7ba304617398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:26.949783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61374f8-fb46-413f-9b21-96c19e952422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:26.950529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ec60c-acbd-42e6-86cb-7ba304617398 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:26.951012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ec60c-acbd-42e6-86cb-7ba304617398 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:26.951429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ec60c-acbd-42e6-86cb-7ba304617398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:26.955757 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61374f8-fb46-413f-9b21-96c19e952422 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:26.961745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:26.964807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ec60c-acbd-42e6-86cb-7ba304617398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:26.966758 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ec60c-acbd-42e6-86cb-7ba304617398 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:26.983340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 935/1872] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:08:26.985520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 938/1873] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:26.989456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ec60c-acbd-42e6-86cb-7ba304617398 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:27.002092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ec60c-acbd-42e6-86cb-7ba304617398 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:27.007956 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e117ce-6a13-475b-a1df-31ee886cdd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:27.008785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e117ce-6a13-475b-a1df-31ee886cdd02 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:27.009109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e117ce-6a13-475b-a1df-31ee886cdd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:27.009374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e117ce-6a13-475b-a1df-31ee886cdd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:27.010243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e117ce-6a13-475b-a1df-31ee886cdd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:27.013031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e117ce-6a13-475b-a1df-31ee886cdd02 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:27.033461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61374f8-fb46-413f-9b21-96c19e952422 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:27.033726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 936/1874] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:27.045752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61374f8-fb46-413f-9b21-96c19e952422 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:27.052868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89576-84a2-4e28-ae5f-eec453f26eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:27.054267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89576-84a2-4e28-ae5f-eec453f26eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:27.055436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89576-84a2-4e28-ae5f-eec453f26eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:27.055912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b89576-84a2-4e28-ae5f-eec453f26eb4 admin admin] PATH_INFO: `/v3/projects/b025abd8496442408a4fde1926bf33f6/users/a1ab73385eb84d3eb59127ab1a317305/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:27.077099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b89576-84a2-4e28-ae5f-eec453f26eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b025abd8496442408a4fde1926bf33f6, user_id=a1ab73385eb84d3eb59127ab1a317305, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:27.081654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b89576-84a2-4e28-ae5f-eec453f26eb4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:27.111648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 939/1875] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:27 2022] PUT /identity/v3/projects/b025abd8496442408a4fde1926bf33f6/users/a1ab73385eb84d3eb59127ab1a317305/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:27.112801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ceea7-44ef-4465-ba3f-d41489646d43 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:27.113200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ceea7-44ef-4465-ba3f-d41489646d43 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:27.113923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ceea7-44ef-4465-ba3f-d41489646d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:27.147725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-953ceea7-44ef-4465-ba3f-d41489646d43 None None] MFA Rules not processed for user `a1ab73385eb84d3eb59127ab1a317305`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:27.149380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-953ceea7-44ef-4465-ba3f-d41489646d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:27.258581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 937/1876] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:27.261078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89576-84a2-4e28-ae5f-eec453f26eb4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:27.361392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b89576-84a2-4e28-ae5f-eec453f26eb4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:27.370012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c84544-62da-4327-89b0-66f03e3400c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:27.371008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c84544-62da-4327-89b0-66f03e3400c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:27.371269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c84544-62da-4327-89b0-66f03e3400c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:27.371572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c84544-62da-4327-89b0-66f03e3400c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:27.372650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c84544-62da-4327-89b0-66f03e3400c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:27.377634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c84544-62da-4327-89b0-66f03e3400c9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:27.394021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:27.412414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 940/1877] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:27 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:27.416857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ceea7-44ef-4465-ba3f-d41489646d43 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:27.429688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ceea7-44ef-4465-ba3f-d41489646d43 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:27.533108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c71163-ce6d-4610-9957-1d6d4633562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:27.534111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71163-ce6d-4610-9957-1d6d4633562b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:27.534509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71163-ce6d-4610-9957-1d6d4633562b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:27.535194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71163-ce6d-4610-9957-1d6d4633562b admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:27.536214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c71163-ce6d-4610-9957-1d6d4633562b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:27.539340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c71163-ce6d-4610-9957-1d6d4633562b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:27.565976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 938/1878] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:27 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:27.567223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c84544-62da-4327-89b0-66f03e3400c9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:27.578787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c84544-62da-4327-89b0-66f03e3400c9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:27.584353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6c495-b683-46a0-88e4-8f65f3e05684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:27.585047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c495-b683-46a0-88e4-8f65f3e05684 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:27.585330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c495-b683-46a0-88e4-8f65f3e05684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:27.585607 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c495-b683-46a0-88e4-8f65f3e05684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:27.586404 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6c495-b683-46a0-88e4-8f65f3e05684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:27.588156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6c495-b683-46a0-88e4-8f65f3e05684 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:27.600704 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 941/1879] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:27.613947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c71163-ce6d-4610-9957-1d6d4633562b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:27.626906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c71163-ce6d-4610-9957-1d6d4633562b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:27.633394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5dd21-3c79-4ac2-822c-021c8ae05787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:27.634451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5dd21-3c79-4ac2-822c-021c8ae05787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:27.634867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5dd21-3c79-4ac2-822c-021c8ae05787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:27.635242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5dd21-3c79-4ac2-822c-021c8ae05787 admin admin] PATH_INFO: `/v3/projects/d809e494df194dc6ba666e64cae8d265/users/d146679abc8d4cfba4a41b8f84ea9f27/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:27.684886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5dd21-3c79-4ac2-822c-021c8ae05787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d809e494df194dc6ba666e64cae8d265, user_id=d146679abc8d4cfba4a41b8f84ea9f27, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:27.688638 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5dd21-3c79-4ac2-822c-021c8ae05787 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:27.714201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 939/1880] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:27 2022] PUT /identity/v3/projects/d809e494df194dc6ba666e64cae8d265/users/d146679abc8d4cfba4a41b8f84ea9f27/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:27.718054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6c495-b683-46a0-88e4-8f65f3e05684 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:27.733030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6c495-b683-46a0-88e4-8f65f3e05684 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:27.834638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23d9e5-a5b1-40ab-97f0-edc0e4d13d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:27.835615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23d9e5-a5b1-40ab-97f0-edc0e4d13d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:27.836087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23d9e5-a5b1-40ab-97f0-edc0e4d13d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:27.836549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23d9e5-a5b1-40ab-97f0-edc0e4d13d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:27.837460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23d9e5-a5b1-40ab-97f0-edc0e4d13d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:27.839401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23d9e5-a5b1-40ab-97f0-edc0e4d13d70 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:27.855577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 942/1881] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:27.857619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5dd21-3c79-4ac2-822c-021c8ae05787 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:27.877214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5dd21-3c79-4ac2-822c-021c8ae05787 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:27.896616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd5c07-45b4-440a-956b-f45304e8aa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:27.898982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd5c07-45b4-440a-956b-f45304e8aa2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:27.900073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd5c07-45b4-440a-956b-f45304e8aa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:27.900411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd5c07-45b4-440a-956b-f45304e8aa2f admin admin] PATH_INFO: `/v3/projects/d809e494df194dc6ba666e64cae8d265/users/d146679abc8d4cfba4a41b8f84ea9f27/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:27.910948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd5c07-45b4-440a-956b-f45304e8aa2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d809e494df194dc6ba666e64cae8d265, user_id=d146679abc8d4cfba4a41b8f84ea9f27, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:27.915577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd5c07-45b4-440a-956b-f45304e8aa2f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:27.956691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 940/1882] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:27 2022] PUT /identity/v3/projects/d809e494df194dc6ba666e64cae8d265/users/d146679abc8d4cfba4a41b8f84ea9f27/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:27.966920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4c487-bcef-4bd7-8906-94a35debfca4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:27.967519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4c487-bcef-4bd7-8906-94a35debfca4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:27.967942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4c487-bcef-4bd7-8906-94a35debfca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:28.026120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fee4c487-bcef-4bd7-8906-94a35debfca4 None None] MFA Rules not processed for user `d146679abc8d4cfba4a41b8f84ea9f27`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:28.027318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fee4c487-bcef-4bd7-8906-94a35debfca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:28.162527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 943/1883] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:28.163543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd5c07-45b4-440a-956b-f45304e8aa2f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:28.165725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4bcd5c07-45b4-440a-956b-f45304e8aa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:28.246377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:28.279236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4c487-bcef-4bd7-8906-94a35debfca4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:28.281794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fee4c487-bcef-4bd7-8906-94a35debfca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:28.294009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd5c07-45b4-440a-956b-f45304e8aa2f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:28.307673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2a3df-fc68-4303-8b07-b96452fb2a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:28.308927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2a3df-fc68-4303-8b07-b96452fb2a7c service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:28.309427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2a3df-fc68-4303-8b07-b96452fb2a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:28.309899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2a3df-fc68-4303-8b07-b96452fb2a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:28.435128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4c487-bcef-4bd7-8906-94a35debfca4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:28.445942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40132951-d550-4334-baec-676938f47248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:28.447463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132951-d550-4334-baec-676938f47248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:28.450521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132951-d550-4334-baec-676938f47248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:28.451076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132951-d550-4334-baec-676938f47248 admin admin] PATH_INFO: `/v3/projects/b6d6dd0d8d044d2bac4e81c1b7530a9b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:28.453955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40132951-d550-4334-baec-676938f47248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d6dd0d8d044d2bac4e81c1b7530a9b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:28.457156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40132951-d550-4334-baec-676938f47248 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:28.470321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:28.498233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2a3df-fc68-4303-8b07-b96452fb2a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:28.500123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2a3df-fc68-4303-8b07-b96452fb2a7c service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:28.527011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 941/1884] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:08:28.553457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40132951-d550-4334-baec-676938f47248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d6dd0d8d044d2bac4e81c1b7530a9b', 'request_id': 'req-40132951-d550-4334-baec-676938f47248'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:28.568529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40132951-d550-4334-baec-676938f47248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d6dd0d8d044d2bac4e81c1b7530a9b', 'request_id': 'req-40132951-d550-4334-baec-676938f47248'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:28.583657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40132951-d550-4334-baec-676938f47248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d6dd0d8d044d2bac4e81c1b7530a9b', 'request_id': 'req-40132951-d550-4334-baec-676938f47248'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:28.598388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40132951-d550-4334-baec-676938f47248 admin admin] The token cache is being invalidate because project b6d6dd0d8d044d2bac4e81c1b7530a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:28.598388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40132951-d550-4334-baec-676938f47248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:28.599263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-40132951-d550-4334-baec-676938f47248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:28.602622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 944/1885] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:28 2022] DELETE /identity/v3/projects/b6d6dd0d8d044d2bac4e81c1b7530a9b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:28.607629 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2a3df-fc68-4303-8b07-b96452fb2a7c service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:28.619978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2a3df-fc68-4303-8b07-b96452fb2a7c service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:28.721830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:28.721830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:28.721830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:28.721830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] PATH_INFO: `/v3/users/bc3e4675d3e74ea2ba8d827df2f7b923` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:28.723609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3e4675d3e74ea2ba8d827df2f7b923)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:28.725593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:28.802923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3e4675d3e74ea2ba8d827df2f7b923'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:28.803604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3e4675d3e74ea2ba8d827df2f7b923'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:28.812437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3e4675d3e74ea2ba8d827df2f7b923'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:28.813355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3e4675d3e74ea2ba8d827df2f7b923'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:28.828945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3e4675d3e74ea2ba8d827df2f7b923'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:28.840284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:28.848135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 942/1886] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:28 2022] DELETE /identity/v3/users/bc3e4675d3e74ea2ba8d827df2f7b923 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:29.254124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40132951-d550-4334-baec-676938f47248 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:29.255654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-40132951-d550-4334-baec-676938f47248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:29.272174 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40132951-d550-4334-baec-676938f47248 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:29.334288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:29.335185 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:29.335471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:29.335760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] PATH_INFO: `/v3/projects/70816748710143fc9536eaa48a2e291d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:29.336913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70816748710143fc9536eaa48a2e291d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:29.338838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:29.384545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70816748710143fc9536eaa48a2e291d', 'request_id': 'req-357dc681-f4b1-44e7-a8a2-6676c100eec4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:29.391842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70816748710143fc9536eaa48a2e291d', 'request_id': 'req-357dc681-f4b1-44e7-a8a2-6676c100eec4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:29.398069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70816748710143fc9536eaa48a2e291d', 'request_id': 'req-357dc681-f4b1-44e7-a8a2-6676c100eec4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:29.408410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] The token cache is being invalidate because project 70816748710143fc9536eaa48a2e291d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:29.408688 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:29.409302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:29.410851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 945/1887] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:29 2022] DELETE /identity/v3/projects/70816748710143fc9536eaa48a2e291d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:29.414847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:29.416319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:29.428824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742b70b-38d4-4c88-ab18-2b4d33272ca0 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:29.486671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:29.487588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:29.487875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:29.488151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] PATH_INFO: `/v3/users/9485fac88a7a448a8139caecc188d5f3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:29.489352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9485fac88a7a448a8139caecc188d5f3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:29.491317 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:29.555033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9485fac88a7a448a8139caecc188d5f3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:29.555689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9485fac88a7a448a8139caecc188d5f3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:29.563427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9485fac88a7a448a8139caecc188d5f3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:29.564112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9485fac88a7a448a8139caecc188d5f3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:29.577372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e716ab9b-bfae-4743-84e0-f5e11a134dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9485fac88a7a448a8139caecc188d5f3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:29.593771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 943/1888] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:29 2022] DELETE /identity/v3/users/9485fac88a7a448a8139caecc188d5f3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:29.897534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:29.899218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:29.914977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc681-f4b1-44e7-a8a2-6676c100eec4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:29.937492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:29.978823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:29.979694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:29.979980 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:29.980334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] PATH_INFO: `/v3/projects/54cbc21e56454a7db1699b3f32a3df65` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:29.981445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54cbc21e56454a7db1699b3f32a3df65)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:29.983412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.031705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54cbc21e56454a7db1699b3f32a3df65', 'request_id': 'req-7ed35eef-cfd3-4433-aecd-654e3a36cec6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:30.040102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54cbc21e56454a7db1699b3f32a3df65', 'request_id': 'req-7ed35eef-cfd3-4433-aecd-654e3a36cec6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:30.047336 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54cbc21e56454a7db1699b3f32a3df65', 'request_id': 'req-7ed35eef-cfd3-4433-aecd-654e3a36cec6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:30.058121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] The token cache is being invalidate because project 54cbc21e56454a7db1699b3f32a3df65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:30.058503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:30.059289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7ed35eef-cfd3-4433-aecd-654e3a36cec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:30.061088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 946/1889] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:29 2022] DELETE /identity/v3/projects/54cbc21e56454a7db1699b3f32a3df65 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:30.067604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff851-b59f-4555-9fb6-5a3f60b98e1b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.067736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff851-b59f-4555-9fb6-5a3f60b98e1b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.068027 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff851-b59f-4555-9fb6-5a3f60b98e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.085827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-945ff851-b59f-4555-9fb6-5a3f60b98e1b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:30.087114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-945ff851-b59f-4555-9fb6-5a3f60b98e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:30.163862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 944/1890] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:30.174316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a100f1-89ab-4f30-a68a-3d913769f595 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.174768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a100f1-89ab-4f30-a68a-3d913769f595 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.175199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a100f1-89ab-4f30-a68a-3d913769f595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.198825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-46a100f1-89ab-4f30-a68a-3d913769f595 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:30.200139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-46a100f1-89ab-4f30-a68a-3d913769f595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:30.215101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 947/1891] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:30.217048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ff851-b59f-4555-9fb6-5a3f60b98e1b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:30.238205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ff851-b59f-4555-9fb6-5a3f60b98e1b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:30.244304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13e9e2-ca6b-428f-87b7-9ef97f8b3653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:30.244844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13e9e2-ca6b-428f-87b7-9ef97f8b3653 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.245138 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13e9e2-ca6b-428f-87b7-9ef97f8b3653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.245417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13e9e2-ca6b-428f-87b7-9ef97f8b3653 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.246368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13e9e2-ca6b-428f-87b7-9ef97f8b3653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:30.246689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13e9e2-ca6b-428f-87b7-9ef97f8b3653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:30.248324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13e9e2-ca6b-428f-87b7-9ef97f8b3653 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.262885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 945/1892] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:08:30.268435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a100f1-89ab-4f30-a68a-3d913769f595 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:30.282839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a100f1-89ab-4f30-a68a-3d913769f595 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:30.288339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a67496-7ed2-4113-a7c1-5448dfe84815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:30.289094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a67496-7ed2-4113-a7c1-5448dfe84815 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.289445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a67496-7ed2-4113-a7c1-5448dfe84815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.290474 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a67496-7ed2-4113-a7c1-5448dfe84815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.291210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a67496-7ed2-4113-a7c1-5448dfe84815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:30.293314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a67496-7ed2-4113-a7c1-5448dfe84815 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.329329 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 948/1893] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:30 2022] POST /identity/v3/projects => generated 401 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:30.333952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13e9e2-ca6b-428f-87b7-9ef97f8b3653 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:30.341940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:30.346931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13e9e2-ca6b-428f-87b7-9ef97f8b3653 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:30.420927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99402e-8887-4a49-b2f9-172672e48fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:30.421566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99402e-8887-4a49-b2f9-172672e48fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.421790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99402e-8887-4a49-b2f9-172672e48fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.422729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99402e-8887-4a49-b2f9-172672e48fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.423443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99402e-8887-4a49-b2f9-172672e48fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:30.425569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99402e-8887-4a49-b2f9-172672e48fc1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.449387 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 946/1894] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:30 2022] POST /identity/v3/users => generated 301 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:30.450413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a67496-7ed2-4113-a7c1-5448dfe84815 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:30.461729 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a67496-7ed2-4113-a7c1-5448dfe84815 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:30.466387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e11f8-b185-4b50-8473-4b1bfd16bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:30.467068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e11f8-b185-4b50-8473-4b1bfd16bf55 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.467354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e11f8-b185-4b50-8473-4b1bfd16bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.467633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e11f8-b185-4b50-8473-4b1bfd16bf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.468386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e11f8-b185-4b50-8473-4b1bfd16bf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:30.470681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e11f8-b185-4b50-8473-4b1bfd16bf55 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.482735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 949/1895] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:30.486296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99402e-8887-4a49-b2f9-172672e48fc1 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:30.497424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99402e-8887-4a49-b2f9-172672e48fc1 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:30.502195 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ae8f8-9e61-44e1-afac-118c4877feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:30.502895 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ae8f8-9e61-44e1-afac-118c4877feaa admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.503187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ae8f8-9e61-44e1-afac-118c4877feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.503476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ae8f8-9e61-44e1-afac-118c4877feaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.504240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ae8f8-9e61-44e1-afac-118c4877feaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:30.505820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ae8f8-9e61-44e1-afac-118c4877feaa admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.525168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 947/1896] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:30.526314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e11f8-b185-4b50-8473-4b1bfd16bf55 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:30.537136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e11f8-b185-4b50-8473-4b1bfd16bf55 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:30.541786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76106923-e02b-474b-932f-0edc437ba31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:30.542659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76106923-e02b-474b-932f-0edc437ba31b admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.542970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76106923-e02b-474b-932f-0edc437ba31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.543247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76106923-e02b-474b-932f-0edc437ba31b admin admin] PATH_INFO: `/v3/projects/a423f2fc7fb0470ea00c9e05a2eecb05/users/f1edecaccccc4666960a9a3c292581f6/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.557606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76106923-e02b-474b-932f-0edc437ba31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a423f2fc7fb0470ea00c9e05a2eecb05, user_id=f1edecaccccc4666960a9a3c292581f6, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:30.560353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76106923-e02b-474b-932f-0edc437ba31b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.574268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 950/1897] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:30 2022] PUT /identity/v3/projects/a423f2fc7fb0470ea00c9e05a2eecb05/users/f1edecaccccc4666960a9a3c292581f6/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:30.586511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c051-db2a-47d3-bd1c-6ef417c9a625 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.586856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c051-db2a-47d3-bd1c-6ef417c9a625 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.587264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c051-db2a-47d3-bd1c-6ef417c9a625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.619258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ec11c051-db2a-47d3-bd1c-6ef417c9a625 None None] MFA Rules not processed for user `f1edecaccccc4666960a9a3c292581f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:30.620475 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ec11c051-db2a-47d3-bd1c-6ef417c9a625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:30.685271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 948/1898] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:30.689778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76106923-e02b-474b-932f-0edc437ba31b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:30.741170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:30.756892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76106923-e02b-474b-932f-0edc437ba31b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:30.764061 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab0581-7ef6-4702-9ac5-416f8f406392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:30.764822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab0581-7ef6-4702-9ac5-416f8f406392 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.765175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab0581-7ef6-4702-9ac5-416f8f406392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.765522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab0581-7ef6-4702-9ac5-416f8f406392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.767372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab0581-7ef6-4702-9ac5-416f8f406392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:30.768972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab0581-7ef6-4702-9ac5-416f8f406392 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.798390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 951/1899] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:30 2022] POST /identity/v3/projects => generated 399 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:30.802302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11c051-db2a-47d3-bd1c-6ef417c9a625 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:30.814466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11c051-db2a-47d3-bd1c-6ef417c9a625 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:30.876513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1045587-977e-4e18-acf9-e5baf0c10de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:30.877233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1045587-977e-4e18-acf9-e5baf0c10de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.877516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1045587-977e-4e18-acf9-e5baf0c10de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.877790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1045587-977e-4e18-acf9-e5baf0c10de3 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.878512 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1045587-977e-4e18-acf9-e5baf0c10de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:30.880686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1045587-977e-4e18-acf9-e5baf0c10de3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.901187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 949/1900] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:30 2022] POST /identity/v3/users => generated 306 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:30.905191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab0581-7ef6-4702-9ac5-416f8f406392 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:30.915712 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab0581-7ef6-4702-9ac5-416f8f406392 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:30.920265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46d78-7940-42ab-aaf8-7648ca43ce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:30.920923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46d78-7940-42ab-aaf8-7648ca43ce0f admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.921242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46d78-7940-42ab-aaf8-7648ca43ce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.921524 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46d78-7940-42ab-aaf8-7648ca43ce0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.922298 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46d78-7940-42ab-aaf8-7648ca43ce0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:30.923913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46d78-7940-42ab-aaf8-7648ca43ce0f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.934278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 952/1901] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:30.939046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1045587-977e-4e18-acf9-e5baf0c10de3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:30.944063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:30.951216 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1045587-977e-4e18-acf9-e5baf0c10de3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:30.956604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9dcad-13c2-442a-b03b-41bd6bece44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:30.957515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9dcad-13c2-442a-b03b-41bd6bece44b admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:30.957799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9dcad-13c2-442a-b03b-41bd6bece44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:30.958073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9dcad-13c2-442a-b03b-41bd6bece44b admin admin] PATH_INFO: `/v3/projects/5331714194d24cfdbf7b774a68c0a963/users/818b017fb54745f3b1a98415111b3815/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:30.972764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9dcad-13c2-442a-b03b-41bd6bece44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5331714194d24cfdbf7b774a68c0a963, user_id=818b017fb54745f3b1a98415111b3815, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:30.975462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9dcad-13c2-442a-b03b-41bd6bece44b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:30.988199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 950/1902] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:30 2022] PUT /identity/v3/projects/5331714194d24cfdbf7b774a68c0a963/users/818b017fb54745f3b1a98415111b3815/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:30.992099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46d78-7940-42ab-aaf8-7648ca43ce0f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:31.002643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46d78-7940-42ab-aaf8-7648ca43ce0f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:31.062172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc65d3-d265-4434-a9d8-a5f0b16726bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:31.063432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc65d3-d265-4434-a9d8-a5f0b16726bb admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:31.063815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc65d3-d265-4434-a9d8-a5f0b16726bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:31.064097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc65d3-d265-4434-a9d8-a5f0b16726bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:31.064849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc65d3-d265-4434-a9d8-a5f0b16726bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:31.066433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc65d3-d265-4434-a9d8-a5f0b16726bb admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:31.077921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 953/1903] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:31.082879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9dcad-13c2-442a-b03b-41bd6bece44b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:31.093695 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9dcad-13c2-442a-b03b-41bd6bece44b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:31.098415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2cfc1-84cb-40c5-88ce-230f6344799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:31.099442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2cfc1-84cb-40c5-88ce-230f6344799b admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:31.099794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2cfc1-84cb-40c5-88ce-230f6344799b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:31.100141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2cfc1-84cb-40c5-88ce-230f6344799b admin admin] PATH_INFO: `/v3/projects/5331714194d24cfdbf7b774a68c0a963/users/818b017fb54745f3b1a98415111b3815/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:31.102176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2cfc1-84cb-40c5-88ce-230f6344799b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5331714194d24cfdbf7b774a68c0a963, user_id=818b017fb54745f3b1a98415111b3815, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:31.104923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2cfc1-84cb-40c5-88ce-230f6344799b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:31.115925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 951/1904] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:31 2022] PUT /identity/v3/projects/5331714194d24cfdbf7b774a68c0a963/users/818b017fb54745f3b1a98415111b3815/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:31.126871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79f74-416d-4fea-a67a-e15e1c408551 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:31.127154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79f74-416d-4fea-a67a-e15e1c408551 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:31.127432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c79f74-416d-4fea-a67a-e15e1c408551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:31.156455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b1c79f74-416d-4fea-a67a-e15e1c408551 None None] MFA Rules not processed for user `818b017fb54745f3b1a98415111b3815`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:31.157710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b1c79f74-416d-4fea-a67a-e15e1c408551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:31.226068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 954/1905] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:31.237630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2cfc1-84cb-40c5-88ce-230f6344799b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:31.239354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dec2cfc1-84cb-40c5-88ce-230f6344799b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:31.302087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2cfc1-84cb-40c5-88ce-230f6344799b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:31.306874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e00eb-80e1-4fb8-8db8-bb282bdf4a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:31.307522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e00eb-80e1-4fb8-8db8-bb282bdf4a7f service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:31.307814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e00eb-80e1-4fb8-8db8-bb282bdf4a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:31.308085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e00eb-80e1-4fb8-8db8-bb282bdf4a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:31.318782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e00eb-80e1-4fb8-8db8-bb282bdf4a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:31.320244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e00eb-80e1-4fb8-8db8-bb282bdf4a7f service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:31.330202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 952/1906] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:31 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:31.415072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79f74-416d-4fea-a67a-e15e1c408551 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:31.426909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c79f74-416d-4fea-a67a-e15e1c408551 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:31.431231 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c162b7-284d-42f0-9fee-ee518381faed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:31.432085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c162b7-284d-42f0-9fee-ee518381faed service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:31.432572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c162b7-284d-42f0-9fee-ee518381faed service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:31.433051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c162b7-284d-42f0-9fee-ee518381faed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:31.485262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:31.499425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c162b7-284d-42f0-9fee-ee518381faed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:31.500874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c162b7-284d-42f0-9fee-ee518381faed service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:31.514279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 955/1907] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:35.430007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e00eb-80e1-4fb8-8db8-bb282bdf4a7f service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:35.438180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e00eb-80e1-4fb8-8db8-bb282bdf4a7f service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:35.441815 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc21784-06fd-44a1-a496-c0640feb3014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:35.442499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc21784-06fd-44a1-a496-c0640feb3014 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:35.442820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc21784-06fd-44a1-a496-c0640feb3014 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:35.443093 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc21784-06fd-44a1-a496-c0640feb3014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:35.444830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9cc21784-06fd-44a1-a496-c0640feb3014 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:35.508350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc21784-06fd-44a1-a496-c0640feb3014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:35.509795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc21784-06fd-44a1-a496-c0640feb3014 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:35.519891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 953/1908] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:36.115087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c162b7-284d-42f0-9fee-ee518381faed service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:36.116580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e2c162b7-284d-42f0-9fee-ee518381faed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:36.201584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c162b7-284d-42f0-9fee-ee518381faed service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:36.207752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:36.208704 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:36.209060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:36.209399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] PATH_INFO: `/v3/users/d19bc538d7d44766b1948862a16b359b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:36.210656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19bc538d7d44766b1948862a16b359b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:36.212661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:36.276430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19bc538d7d44766b1948862a16b359b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:36.287226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19bc538d7d44766b1948862a16b359b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:36.287988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19bc538d7d44766b1948862a16b359b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:36.288652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19bc538d7d44766b1948862a16b359b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:36.303002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19bc538d7d44766b1948862a16b359b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:36.318204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 956/1909] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:36 2022] DELETE /identity/v3/users/d19bc538d7d44766b1948862a16b359b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:36.322676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c4336-7a1c-4b14-a4f7-61de6434bd74 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:36.322998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c4336-7a1c-4b14-a4f7-61de6434bd74 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:36.323273 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c4336-7a1c-4b14-a4f7-61de6434bd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:36.342823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-197c4336-7a1c-4b14-a4f7-61de6434bd74 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:36.344735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-197c4336-7a1c-4b14-a4f7-61de6434bd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:36.414507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 954/1910] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:36.425398 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:36.427127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:36.494303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2d1b8-5f25-42a1-9aeb-ce8dfee94091 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:36.498108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792baa-f324-4542-804e-3a9936c50cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:36.498956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792baa-f324-4542-804e-3a9936c50cfb service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:36.499348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792baa-f324-4542-804e-3a9936c50cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:36.499756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792baa-f324-4542-804e-3a9936c50cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:36.514976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56792baa-f324-4542-804e-3a9936c50cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:36.517019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56792baa-f324-4542-804e-3a9936c50cfb service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:36.528539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 957/1911] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:36.867604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c4336-7a1c-4b14-a4f7-61de6434bd74 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:36.869921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-197c4336-7a1c-4b14-a4f7-61de6434bd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:36.880398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:36.893323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c4336-7a1c-4b14-a4f7-61de6434bd74 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:36.906946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:36.908115 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:36.908397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:36.908831 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] PATH_INFO: `/v3/projects/003506bc46d442929985e0fd761ba9cb` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:36.910122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] RBAC: Authorizing `identity:delete_project(project_id=003506bc46d442929985e0fd761ba9cb)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:36.912361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:36.968603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003506bc46d442929985e0fd761ba9cb', 'request_id': 'req-343cce0e-aa31-4abc-93ae-b4ea554f603f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:36.976445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003506bc46d442929985e0fd761ba9cb', 'request_id': 'req-343cce0e-aa31-4abc-93ae-b4ea554f603f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:36.982230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003506bc46d442929985e0fd761ba9cb', 'request_id': 'req-343cce0e-aa31-4abc-93ae-b4ea554f603f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:36.993811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] The token cache is being invalidate because project 003506bc46d442929985e0fd761ba9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:36.994136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:36.995875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:36.997158 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 955/1912] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:36 2022] DELETE /identity/v3/projects/003506bc46d442929985e0fd761ba9cb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:37.001710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792baa-f324-4542-804e-3a9936c50cfb service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:37.011663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792baa-f324-4542-804e-3a9936c50cfb service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:37.015328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:37.072385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:37.073454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:37.073741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:37.074015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] PATH_INFO: `/v3/users/97fb63eabc3c48e79f844873a64e8b96` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:37.075222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fb63eabc3c48e79f844873a64e8b96)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:37.077140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:37.125902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fb63eabc3c48e79f844873a64e8b96'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:37.135429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fb63eabc3c48e79f844873a64e8b96'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:37.136126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fb63eabc3c48e79f844873a64e8b96'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:37.136771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fb63eabc3c48e79f844873a64e8b96'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:37.149844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d849c961-cfcf-4fda-aa3b-d48ae6c65360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fb63eabc3c48e79f844873a64e8b96'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:37.164362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 958/1913] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:37 2022] DELETE /identity/v3/users/97fb63eabc3c48e79f844873a64e8b96 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:37.458453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:37.459903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:37.474754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cce0e-aa31-4abc-93ae-b4ea554f603f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:37.533660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:37.534559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:37.534916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:37.535191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] PATH_INFO: `/v3/projects/6ac4fe3a3eea4d9388f93e4610781b9c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:37.536504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac4fe3a3eea4d9388f93e4610781b9c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:37.538444 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:37.591526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac4fe3a3eea4d9388f93e4610781b9c', 'request_id': 'req-2b8721e5-6284-4d7c-bde0-e2407fe1469f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:37.599907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac4fe3a3eea4d9388f93e4610781b9c', 'request_id': 'req-2b8721e5-6284-4d7c-bde0-e2407fe1469f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:37.605480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac4fe3a3eea4d9388f93e4610781b9c', 'request_id': 'req-2b8721e5-6284-4d7c-bde0-e2407fe1469f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:37.617439 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] The token cache is being invalidate because project 6ac4fe3a3eea4d9388f93e4610781b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:37.617728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:37.618347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2b8721e5-6284-4d7c-bde0-e2407fe1469f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:37.620122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 956/1914] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:37 2022] DELETE /identity/v3/projects/6ac4fe3a3eea4d9388f93e4610781b9c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:37.626646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cec6e-fc54-48ac-9a31-49d6fa7d1657 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:37.627036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cec6e-fc54-48ac-9a31-49d6fa7d1657 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:37.627322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cec6e-fc54-48ac-9a31-49d6fa7d1657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:37.645111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e53cec6e-fc54-48ac-9a31-49d6fa7d1657 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:37.646313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e53cec6e-fc54-48ac-9a31-49d6fa7d1657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:37.706718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 959/1915] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:37.716121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a6927-8c4d-4359-b55e-5769fcf15f16 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:37.716411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a6927-8c4d-4359-b55e-5769fcf15f16 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:37.716689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a6927-8c4d-4359-b55e-5769fcf15f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:37.736981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-371a6927-8c4d-4359-b55e-5769fcf15f16 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:37.738332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-371a6927-8c4d-4359-b55e-5769fcf15f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:37.747201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 957/1916] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:37.751657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cec6e-fc54-48ac-9a31-49d6fa7d1657 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:37.763952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cec6e-fc54-48ac-9a31-49d6fa7d1657 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:37.769292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb34bc6-1b36-4744-9d02-cb9c08205f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:37.769994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb34bc6-1b36-4744-9d02-cb9c08205f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:37.770367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb34bc6-1b36-4744-9d02-cb9c08205f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:37.770646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb34bc6-1b36-4744-9d02-cb9c08205f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:37.771427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb34bc6-1b36-4744-9d02-cb9c08205f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:37.771736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb34bc6-1b36-4744-9d02-cb9c08205f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:37.773339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb34bc6-1b36-4744-9d02-cb9c08205f18 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:37.788720 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 960/1917] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:08:37.790857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a6927-8c4d-4359-b55e-5769fcf15f16 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:37.801407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a6927-8c4d-4359-b55e-5769fcf15f16 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:37.806175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81016c-c670-4bec-8355-ad71d70c7161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:37.806872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81016c-c670-4bec-8355-ad71d70c7161 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:37.807163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81016c-c670-4bec-8355-ad71d70c7161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:37.807445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81016c-c670-4bec-8355-ad71d70c7161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:37.808137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81016c-c670-4bec-8355-ad71d70c7161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:37.810042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81016c-c670-4bec-8355-ad71d70c7161 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:37.814546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:37.839669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 958/1918] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:37 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:37.844255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb34bc6-1b36-4744-9d02-cb9c08205f18 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:37.854488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb34bc6-1b36-4744-9d02-cb9c08205f18 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:37.866911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:37.917874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1f782-3dc8-45a8-b43f-d0f22d065e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:37.918534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1f782-3dc8-45a8-b43f-d0f22d065e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:37.918849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1f782-3dc8-45a8-b43f-d0f22d065e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:37.919121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1f782-3dc8-45a8-b43f-d0f22d065e59 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:37.919833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1f782-3dc8-45a8-b43f-d0f22d065e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:37.922789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1f782-3dc8-45a8-b43f-d0f22d065e59 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:37.944399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 961/1919] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:37 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:08:37.948409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81016c-c670-4bec-8355-ad71d70c7161 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:37.962624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81016c-c670-4bec-8355-ad71d70c7161 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:37.968054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531364-f4dd-4bea-9736-91c750cd6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:37.970544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531364-f4dd-4bea-9736-91c750cd6975 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:37.971045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531364-f4dd-4bea-9736-91c750cd6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:37.971229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531364-f4dd-4bea-9736-91c750cd6975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:37.972087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1531364-f4dd-4bea-9736-91c750cd6975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:37.973776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1531364-f4dd-4bea-9736-91c750cd6975 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:37.985298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 959/1920] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:37.989257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1f782-3dc8-45a8-b43f-d0f22d065e59 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:37.999488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1f782-3dc8-45a8-b43f-d0f22d065e59 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:38.004130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1858f-d769-4bc8-a44c-dd295565f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:38.004793 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1858f-d769-4bc8-a44c-dd295565f93c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:38.005079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1858f-d769-4bc8-a44c-dd295565f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:38.005358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1858f-d769-4bc8-a44c-dd295565f93c admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:38.006081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1858f-d769-4bc8-a44c-dd295565f93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:38.007989 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1858f-d769-4bc8-a44c-dd295565f93c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:38.019133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 962/1921] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:38.023106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531364-f4dd-4bea-9736-91c750cd6975 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:38.033691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531364-f4dd-4bea-9736-91c750cd6975 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:38.038241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194743-4e46-432e-a59c-f11e2d0bf697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:38.039146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194743-4e46-432e-a59c-f11e2d0bf697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:38.039428 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194743-4e46-432e-a59c-f11e2d0bf697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:38.039696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194743-4e46-432e-a59c-f11e2d0bf697 admin admin] PATH_INFO: `/v3/projects/2684c3e9cd514741894b297794d45bea/users/f7211bcffb8246e8b56b57742b985134/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:38.054050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4194743-4e46-432e-a59c-f11e2d0bf697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2684c3e9cd514741894b297794d45bea, user_id=f7211bcffb8246e8b56b57742b985134, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:38.056721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4194743-4e46-432e-a59c-f11e2d0bf697 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:38.071379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 960/1922] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:38 2022] PUT /identity/v3/projects/2684c3e9cd514741894b297794d45bea/users/f7211bcffb8246e8b56b57742b985134/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:38.083143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a84c-9ff5-49bb-ba76-4b5f0d79e7da None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:38.083493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a84c-9ff5-49bb-ba76-4b5f0d79e7da None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:38.084258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351a84c-9ff5-49bb-ba76-4b5f0d79e7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:38.114885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0351a84c-9ff5-49bb-ba76-4b5f0d79e7da None None] MFA Rules not processed for user `f7211bcffb8246e8b56b57742b985134`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:38.116132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0351a84c-9ff5-49bb-ba76-4b5f0d79e7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:38.185052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 963/1923] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:38.197076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194743-4e46-432e-a59c-f11e2d0bf697 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:38.199057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a4194743-4e46-432e-a59c-f11e2d0bf697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:38.274595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194743-4e46-432e-a59c-f11e2d0bf697 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:38.278200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40050bb3-d1e6-4b65-a409-564d1c411213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:38.278876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050bb3-d1e6-4b65-a409-564d1c411213 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:38.279160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050bb3-d1e6-4b65-a409-564d1c411213 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:38.279436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050bb3-d1e6-4b65-a409-564d1c411213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:38.288499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40050bb3-d1e6-4b65-a409-564d1c411213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:38.289934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40050bb3-d1e6-4b65-a409-564d1c411213 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:38.298665 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 961/1924] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:45.250070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351a84c-9ff5-49bb-ba76-4b5f0d79e7da None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:45.252367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0351a84c-9ff5-49bb-ba76-4b5f0d79e7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:45.317140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351a84c-9ff5-49bb-ba76-4b5f0d79e7da None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:45.321514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:45.322383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:45.322660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:45.322960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] PATH_INFO: `/v3/users/f1edecaccccc4666960a9a3c292581f6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:45.324133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1edecaccccc4666960a9a3c292581f6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:45.326042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:45.349219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:45.372801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1edecaccccc4666960a9a3c292581f6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:45.380750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1edecaccccc4666960a9a3c292581f6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:45.381421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1edecaccccc4666960a9a3c292581f6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:45.382024 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1edecaccccc4666960a9a3c292581f6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:45.394954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1edecaccccc4666960a9a3c292581f6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:45.413395 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 964/1925] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:45 2022] DELETE /identity/v3/users/f1edecaccccc4666960a9a3c292581f6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:45.418023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04318cfa-9fe6-492d-9076-aaf8123cc05b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:45.418573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04318cfa-9fe6-492d-9076-aaf8123cc05b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:45.418724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04318cfa-9fe6-492d-9076-aaf8123cc05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:45.437076 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-04318cfa-9fe6-492d-9076-aaf8123cc05b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:45.439153 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-04318cfa-9fe6-492d-9076-aaf8123cc05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:45.500397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 962/1926] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:45.510945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:45.513610 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:45.590690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b3c78-0af3-43bf-b48c-9a6da2837fd3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:45.595782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296bd89-a374-42ae-bc32-a4f30bebe700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:45.595993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296bd89-a374-42ae-bc32-a4f30bebe700 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:45.596309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296bd89-a374-42ae-bc32-a4f30bebe700 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:45.596575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296bd89-a374-42ae-bc32-a4f30bebe700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:45.606569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296bd89-a374-42ae-bc32-a4f30bebe700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:45.608058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296bd89-a374-42ae-bc32-a4f30bebe700 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:45.618480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 965/1927] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:45.921129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04318cfa-9fe6-492d-9076-aaf8123cc05b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:45.922609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-04318cfa-9fe6-492d-9076-aaf8123cc05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:45.934302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04318cfa-9fe6-492d-9076-aaf8123cc05b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:45.939015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:45.939867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:45.940151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:45.940427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] PATH_INFO: `/v3/projects/a423f2fc7fb0470ea00c9e05a2eecb05` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:45.941604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a423f2fc7fb0470ea00c9e05a2eecb05)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:45.943557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:45.996426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a423f2fc7fb0470ea00c9e05a2eecb05', 'request_id': 'req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:45.998038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:46.004799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a423f2fc7fb0470ea00c9e05a2eecb05', 'request_id': 'req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.011354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a423f2fc7fb0470ea00c9e05a2eecb05', 'request_id': 'req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.022667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] The token cache is being invalidate because project a423f2fc7fb0470ea00c9e05a2eecb05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:46.022986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.023631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.025165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 963/1928] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:45 2022] DELETE /identity/v3/projects/a423f2fc7fb0470ea00c9e05a2eecb05 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:46.029106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296bd89-a374-42ae-bc32-a4f30bebe700 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:46.039438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296bd89-a374-42ae-bc32-a4f30bebe700 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:46.097979 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:46.098894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:46.099163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:46.099450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] PATH_INFO: `/v3/users/818b017fb54745f3b1a98415111b3815` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:46.100716 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=818b017fb54745f3b1a98415111b3815)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:46.102694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:46.149511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:46.151315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '818b017fb54745f3b1a98415111b3815'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.161767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '818b017fb54745f3b1a98415111b3815'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.162459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '818b017fb54745f3b1a98415111b3815'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.163095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '818b017fb54745f3b1a98415111b3815'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.175381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5c5a4fcf-d8f6-4e86-9d8a-26dc948f5397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '818b017fb54745f3b1a98415111b3815'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.189059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 966/1929] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:46 2022] DELETE /identity/v3/users/818b017fb54745f3b1a98415111b3815 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:46.465679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:46.467323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:46.480360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6bf79-b7c8-4af2-8eac-ddda53eafa56 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:46.538088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:46.538978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:46.539260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:46.539528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] PATH_INFO: `/v3/projects/5331714194d24cfdbf7b774a68c0a963` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:46.540690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5331714194d24cfdbf7b774a68c0a963)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:46.542640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:46.591517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5331714194d24cfdbf7b774a68c0a963', 'request_id': 'req-c2c8c084-95a0-4332-b96a-7fec377c8eb7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.605166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5331714194d24cfdbf7b774a68c0a963', 'request_id': 'req-c2c8c084-95a0-4332-b96a-7fec377c8eb7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.616068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5331714194d24cfdbf7b774a68c0a963', 'request_id': 'req-c2c8c084-95a0-4332-b96a-7fec377c8eb7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.629142 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] The token cache is being invalidate because project 5331714194d24cfdbf7b774a68c0a963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:46.629436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.630101 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c2c8c084-95a0-4332-b96a-7fec377c8eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:46.631677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 964/1930] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:46 2022] DELETE /identity/v3/projects/5331714194d24cfdbf7b774a68c0a963 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:46.637109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa48f6-4b16-4aad-a183-8c9ed678d3e6 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:46.638382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa48f6-4b16-4aad-a183-8c9ed678d3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:46.638745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa48f6-4b16-4aad-a183-8c9ed678d3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:46.656667 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a4aa48f6-4b16-4aad-a183-8c9ed678d3e6 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:46.657911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a4aa48f6-4b16-4aad-a183-8c9ed678d3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:46.734338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 967/1931] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:46.743274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dabc4a-d3b6-421d-977c-f75840db5063 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:46.744636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dabc4a-d3b6-421d-977c-f75840db5063 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:46.744954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dabc4a-d3b6-421d-977c-f75840db5063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:46.766342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-43dabc4a-d3b6-421d-977c-f75840db5063 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:46.767570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-43dabc4a-d3b6-421d-977c-f75840db5063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:46.775718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 965/1932] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:46.779926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa48f6-4b16-4aad-a183-8c9ed678d3e6 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:46.790320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa48f6-4b16-4aad-a183-8c9ed678d3e6 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:46.795797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842aab8-5d0c-4480-8aea-5b698d7830eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:46.796487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842aab8-5d0c-4480-8aea-5b698d7830eb admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:46.796771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842aab8-5d0c-4480-8aea-5b698d7830eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:46.797047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842aab8-5d0c-4480-8aea-5b698d7830eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:46.798750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842aab8-5d0c-4480-8aea-5b698d7830eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:46.799305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842aab8-5d0c-4480-8aea-5b698d7830eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:46.801166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842aab8-5d0c-4480-8aea-5b698d7830eb admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:46.817098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 968/1933] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:08:46.823547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dabc4a-d3b6-421d-977c-f75840db5063 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:46.833598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dabc4a-d3b6-421d-977c-f75840db5063 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:46.838453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384433ff-36cc-4ba6-ac9d-36f4f171c962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:46.839174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384433ff-36cc-4ba6-ac9d-36f4f171c962 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:46.839450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384433ff-36cc-4ba6-ac9d-36f4f171c962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:46.839721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384433ff-36cc-4ba6-ac9d-36f4f171c962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:46.840569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384433ff-36cc-4ba6-ac9d-36f4f171c962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:46.842472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384433ff-36cc-4ba6-ac9d-36f4f171c962 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:46.871637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 966/1934] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:46 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:08:46.876555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842aab8-5d0c-4480-8aea-5b698d7830eb admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:46.887353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842aab8-5d0c-4480-8aea-5b698d7830eb admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:46.960062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcb5f1-0dd8-43d7-95bb-64a944431bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:46.960778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb5f1-0dd8-43d7-95bb-64a944431bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:46.961286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb5f1-0dd8-43d7-95bb-64a944431bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:46.961816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb5f1-0dd8-43d7-95bb-64a944431bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:46.962631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcb5f1-0dd8-43d7-95bb-64a944431bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:46.964601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcb5f1-0dd8-43d7-95bb-64a944431bf2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:46.991296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 969/1935] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:46 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:46.995962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384433ff-36cc-4ba6-ac9d-36f4f171c962 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:47.008797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384433ff-36cc-4ba6-ac9d-36f4f171c962 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:47.013529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e71676-a087-4bd3-b17c-e645bf3f7946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:47.014205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e71676-a087-4bd3-b17c-e645bf3f7946 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.014488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e71676-a087-4bd3-b17c-e645bf3f7946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.014805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e71676-a087-4bd3-b17c-e645bf3f7946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.015535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e71676-a087-4bd3-b17c-e645bf3f7946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:47.017803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e71676-a087-4bd3-b17c-e645bf3f7946 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:47.030906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 967/1936] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:47.035568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcb5f1-0dd8-43d7-95bb-64a944431bf2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:47.046191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcb5f1-0dd8-43d7-95bb-64a944431bf2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:47.051765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ee72-0c00-4452-9380-97f1a92be1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:47.052439 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ee72-0c00-4452-9380-97f1a92be1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.052758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ee72-0c00-4452-9380-97f1a92be1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.053039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ee72-0c00-4452-9380-97f1a92be1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.053768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4ee72-0c00-4452-9380-97f1a92be1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:47.055452 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4ee72-0c00-4452-9380-97f1a92be1ca admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:47.068836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 970/1937] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:47.073361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e71676-a087-4bd3-b17c-e645bf3f7946 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:47.084206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e71676-a087-4bd3-b17c-e645bf3f7946 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:47.089502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da7801-9217-48e2-b3c3-0a6dffc83dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:47.090380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da7801-9217-48e2-b3c3-0a6dffc83dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.090664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da7801-9217-48e2-b3c3-0a6dffc83dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.090971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da7801-9217-48e2-b3c3-0a6dffc83dd6 admin admin] PATH_INFO: `/v3/projects/4fc08ca9cbda4dd981eaafb90adbc534/users/9447f24aba564feba8ed07deb3d0b00f/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.107999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da7801-9217-48e2-b3c3-0a6dffc83dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc08ca9cbda4dd981eaafb90adbc534, user_id=9447f24aba564feba8ed07deb3d0b00f, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:47.111755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da7801-9217-48e2-b3c3-0a6dffc83dd6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:47.126878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 968/1938] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:47 2022] PUT /identity/v3/projects/4fc08ca9cbda4dd981eaafb90adbc534/users/9447f24aba564feba8ed07deb3d0b00f/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:47.137735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9594528-9efd-436e-978e-969962ba96e4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.138062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9594528-9efd-436e-978e-969962ba96e4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.138347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9594528-9efd-436e-978e-969962ba96e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.168230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c9594528-9efd-436e-978e-969962ba96e4 None None] MFA Rules not processed for user `9447f24aba564feba8ed07deb3d0b00f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:47.169836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c9594528-9efd-436e-978e-969962ba96e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:47.188806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:47.252056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 971/1939] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:47.256539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da7801-9217-48e2-b3c3-0a6dffc83dd6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:47.263648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:47.334631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da7801-9217-48e2-b3c3-0a6dffc83dd6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:47.339476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77146a05-a77e-4da7-88ec-ad448569407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:47.340378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77146a05-a77e-4da7-88ec-ad448569407c admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.340670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77146a05-a77e-4da7-88ec-ad448569407c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.340947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77146a05-a77e-4da7-88ec-ad448569407c admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.341634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77146a05-a77e-4da7-88ec-ad448569407c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:47.343584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77146a05-a77e-4da7-88ec-ad448569407c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:47.374690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 969/1940] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:47 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:47.379292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9594528-9efd-436e-978e-969962ba96e4 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:47.392132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9594528-9efd-436e-978e-969962ba96e4 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:47.455784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bf7e6-66b8-486c-8075-839b24301443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:47.456470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf7e6-66b8-486c-8075-839b24301443 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.456752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf7e6-66b8-486c-8075-839b24301443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.457028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bf7e6-66b8-486c-8075-839b24301443 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.457725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bf7e6-66b8-486c-8075-839b24301443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:47.459676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bf7e6-66b8-486c-8075-839b24301443 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:47.489883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 972/1941] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:47 2022] POST /identity/v3/users => generated 301 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:47.491308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77146a05-a77e-4da7-88ec-ad448569407c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:47.501618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77146a05-a77e-4da7-88ec-ad448569407c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:47.513036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538ae61-adb0-4a17-9bd7-e6f8a1deb4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:47.513036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ae61-adb0-4a17-9bd7-e6f8a1deb4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.513036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ae61-adb0-4a17-9bd7-e6f8a1deb4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.513036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ae61-adb0-4a17-9bd7-e6f8a1deb4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.513504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538ae61-adb0-4a17-9bd7-e6f8a1deb4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:47.513504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538ae61-adb0-4a17-9bd7-e6f8a1deb4d6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:47.527760 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 970/1942] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:47.532559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bf7e6-66b8-486c-8075-839b24301443 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:47.542761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bf7e6-66b8-486c-8075-839b24301443 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:47.547493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820ff27-d75b-47b1-a6d9-a2b59196f9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:47.548393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820ff27-d75b-47b1-a6d9-a2b59196f9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.548661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820ff27-d75b-47b1-a6d9-a2b59196f9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.548934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820ff27-d75b-47b1-a6d9-a2b59196f9b8 admin admin] PATH_INFO: `/v3/projects/36d1554928a54e52ad7caeb86e437e77/users/0657575ee3c24c8fb82f445acc8c5ed3/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.564015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820ff27-d75b-47b1-a6d9-a2b59196f9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d1554928a54e52ad7caeb86e437e77, user_id=0657575ee3c24c8fb82f445acc8c5ed3, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:47.566681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820ff27-d75b-47b1-a6d9-a2b59196f9b8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:47.580448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 973/1943] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:47 2022] PUT /identity/v3/projects/36d1554928a54e52ad7caeb86e437e77/users/0657575ee3c24c8fb82f445acc8c5ed3/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:47.584380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538ae61-adb0-4a17-9bd7-e6f8a1deb4d6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:47.595454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538ae61-adb0-4a17-9bd7-e6f8a1deb4d6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:47.658317 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f70e5d-7b81-44a9-9323-410eeefb8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:47.659149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70e5d-7b81-44a9-9323-410eeefb8588 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.659461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70e5d-7b81-44a9-9323-410eeefb8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.659874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70e5d-7b81-44a9-9323-410eeefb8588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.661236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f70e5d-7b81-44a9-9323-410eeefb8588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:47.663841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f70e5d-7b81-44a9-9323-410eeefb8588 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:47.675207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 971/1944] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:47.679557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820ff27-d75b-47b1-a6d9-a2b59196f9b8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:47.690297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820ff27-d75b-47b1-a6d9-a2b59196f9b8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:47.695031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838b4c6-f259-47f8-b9a6-8bc45aa42e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:47.695938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838b4c6-f259-47f8-b9a6-8bc45aa42e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.696222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838b4c6-f259-47f8-b9a6-8bc45aa42e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.696497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838b4c6-f259-47f8-b9a6-8bc45aa42e87 admin admin] PATH_INFO: `/v3/projects/36d1554928a54e52ad7caeb86e437e77/users/0657575ee3c24c8fb82f445acc8c5ed3/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.698468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838b4c6-f259-47f8-b9a6-8bc45aa42e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d1554928a54e52ad7caeb86e437e77, user_id=0657575ee3c24c8fb82f445acc8c5ed3, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:47.701138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838b4c6-f259-47f8-b9a6-8bc45aa42e87 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:47.712107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 974/1945] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:47 2022] PUT /identity/v3/projects/36d1554928a54e52ad7caeb86e437e77/users/0657575ee3c24c8fb82f445acc8c5ed3/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:47.723565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ef84-5939-4d2d-9f65-1e39925a3b37 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.723863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ef84-5939-4d2d-9f65-1e39925a3b37 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.724146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ef84-5939-4d2d-9f65-1e39925a3b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.751689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9e47ef84-5939-4d2d-9f65-1e39925a3b37 None None] MFA Rules not processed for user `0657575ee3c24c8fb82f445acc8c5ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:47.752913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9e47ef84-5939-4d2d-9f65-1e39925a3b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:47.824049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:47.828375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 972/1946] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:47.839223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838b4c6-f259-47f8-b9a6-8bc45aa42e87 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:47.841132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e838b4c6-f259-47f8-b9a6-8bc45aa42e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:47.901638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838b4c6-f259-47f8-b9a6-8bc45aa42e87 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:47.905300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956ca0a-92f9-4fe1-a9cc-ec5c3a49bfb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:47.905945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956ca0a-92f9-4fe1-a9cc-ec5c3a49bfb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:47.906229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956ca0a-92f9-4fe1-a9cc-ec5c3a49bfb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:47.907056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956ca0a-92f9-4fe1-a9cc-ec5c3a49bfb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:47.916134 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956ca0a-92f9-4fe1-a9cc-ec5c3a49bfb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:47.917575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956ca0a-92f9-4fe1-a9cc-ec5c3a49bfb7 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:47.928177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 975/1947] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:48.058186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ef84-5939-4d2d-9f65-1e39925a3b37 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:48.123316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ef84-5939-4d2d-9f65-1e39925a3b37 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:48.127914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:48.128788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:48.129073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:48.129349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] PATH_INFO: `/v3/users/9447f24aba564feba8ed07deb3d0b00f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:48.130518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9447f24aba564feba8ed07deb3d0b00f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:48.132470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:48.181401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9447f24aba564feba8ed07deb3d0b00f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:48.182050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9447f24aba564feba8ed07deb3d0b00f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:48.189131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9447f24aba564feba8ed07deb3d0b00f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:48.189807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9447f24aba564feba8ed07deb3d0b00f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:48.201646 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9447f24aba564feba8ed07deb3d0b00f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:48.215717 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 973/1948] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:48 2022] DELETE /identity/v3/users/9447f24aba564feba8ed07deb3d0b00f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:48.221463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac264e-82f3-4aa1-95af-91e4bf0c2e9d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:48.221780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac264e-82f3-4aa1-95af-91e4bf0c2e9d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:48.222054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac264e-82f3-4aa1-95af-91e4bf0c2e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:48.239749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f4ac264e-82f3-4aa1-95af-91e4bf0c2e9d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:48.240953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f4ac264e-82f3-4aa1-95af-91e4bf0c2e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:48.249074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:48.305333 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 976/1949] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:48.314993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:48.316404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:48.374938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae200f63-6665-4787-b724-7a387e403bdd admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:48.378922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bd795-e794-48ec-a923-4cb29ad5b83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:48.379572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bd795-e794-48ec-a923-4cb29ad5b83b service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:48.379859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bd795-e794-48ec-a923-4cb29ad5b83b service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:48.380140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bd795-e794-48ec-a923-4cb29ad5b83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:48.389339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bd795-e794-48ec-a923-4cb29ad5b83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:48.390804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bd795-e794-48ec-a923-4cb29ad5b83b service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:48.400894 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 974/1950] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:48.850786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac264e-82f3-4aa1-95af-91e4bf0c2e9d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:48.862292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f4ac264e-82f3-4aa1-95af-91e4bf0c2e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:48.870892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac264e-82f3-4aa1-95af-91e4bf0c2e9d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:48.878867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:48.879738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:48.880026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:48.880286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] PATH_INFO: `/v3/projects/4fc08ca9cbda4dd981eaafb90adbc534` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:48.881527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc08ca9cbda4dd981eaafb90adbc534)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:48.883761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:48.934074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc08ca9cbda4dd981eaafb90adbc534', 'request_id': 'req-b629dac0-1f61-494d-a170-945f70225b8f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:48.942180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc08ca9cbda4dd981eaafb90adbc534', 'request_id': 'req-b629dac0-1f61-494d-a170-945f70225b8f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:48.949181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc08ca9cbda4dd981eaafb90adbc534', 'request_id': 'req-b629dac0-1f61-494d-a170-945f70225b8f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:48.959992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] The token cache is being invalidate because project 4fc08ca9cbda4dd981eaafb90adbc534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:48.960281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:48.961075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:48.962628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 977/1951] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:48 2022] DELETE /identity/v3/projects/4fc08ca9cbda4dd981eaafb90adbc534 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:48.966551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bd795-e794-48ec-a923-4cb29ad5b83b service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:48.976400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bd795-e794-48ec-a923-4cb29ad5b83b service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:48.995157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:49.037932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:49.038891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:49.039175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:49.039451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] PATH_INFO: `/v3/users/0657575ee3c24c8fb82f445acc8c5ed3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:49.040688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] RBAC: Authorizing `identity:delete_user(user_id=0657575ee3c24c8fb82f445acc8c5ed3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:49.042549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:49.088494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0657575ee3c24c8fb82f445acc8c5ed3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:49.089140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0657575ee3c24c8fb82f445acc8c5ed3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:49.097304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0657575ee3c24c8fb82f445acc8c5ed3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:49.097942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0657575ee3c24c8fb82f445acc8c5ed3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:49.111193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1c471265-ae1b-4ae5-a33a-f060b77b91df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0657575ee3c24c8fb82f445acc8c5ed3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:49.126221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 975/1952] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:48 2022] DELETE /identity/v3/users/0657575ee3c24c8fb82f445acc8c5ed3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:49.440117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:49.441625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:49.454579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629dac0-1f61-494d-a170-945f70225b8f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:49.519264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:49.520564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:49.522347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:49.522824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] PATH_INFO: `/v3/projects/36d1554928a54e52ad7caeb86e437e77` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:49.524253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d1554928a54e52ad7caeb86e437e77)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:49.526526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:49.581515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:49.591250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d1554928a54e52ad7caeb86e437e77', 'request_id': 'req-3910262c-382f-4a79-b9df-993f79fc99e8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:49.600390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d1554928a54e52ad7caeb86e437e77', 'request_id': 'req-3910262c-382f-4a79-b9df-993f79fc99e8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:49.609349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d1554928a54e52ad7caeb86e437e77', 'request_id': 'req-3910262c-382f-4a79-b9df-993f79fc99e8'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:49.620751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] The token cache is being invalidate because project 36d1554928a54e52ad7caeb86e437e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:49.621036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:49.621672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3910262c-382f-4a79-b9df-993f79fc99e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:49.623276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 978/1953] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:49 2022] DELETE /identity/v3/projects/36d1554928a54e52ad7caeb86e437e77 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:49.628246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796de0d-b14e-431f-8b71-3530b797259b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:49.628746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796de0d-b14e-431f-8b71-3530b797259b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:49.629262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796de0d-b14e-431f-8b71-3530b797259b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:49.650961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f796de0d-b14e-431f-8b71-3530b797259b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:49.652170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f796de0d-b14e-431f-8b71-3530b797259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:49.717185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 976/1954] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:49.725560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0f68-8709-4e09-971d-77d603d82fdd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:49.725849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0f68-8709-4e09-971d-77d603d82fdd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:49.726126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0f68-8709-4e09-971d-77d603d82fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:49.744413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f54e0f68-8709-4e09-971d-77d603d82fdd None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:49.745636 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f54e0f68-8709-4e09-971d-77d603d82fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:49.753503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 979/1955] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:49.757915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796de0d-b14e-431f-8b71-3530b797259b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:49.769112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796de0d-b14e-431f-8b71-3530b797259b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:49.773760 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ec4f1-830c-4761-80c7-60b51a0edc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:49.774430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ec4f1-830c-4761-80c7-60b51a0edc8d admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:49.774739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ec4f1-830c-4761-80c7-60b51a0edc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:49.775022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ec4f1-830c-4761-80c7-60b51a0edc8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:49.775753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ec4f1-830c-4761-80c7-60b51a0edc8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:49.776060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ec4f1-830c-4761-80c7-60b51a0edc8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:49.777668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ec4f1-830c-4761-80c7-60b51a0edc8d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:49.790177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 977/1956] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:08:49.794620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0f68-8709-4e09-971d-77d603d82fdd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:49.804075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0f68-8709-4e09-971d-77d603d82fdd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:49.809238 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a308dc8-aa20-4a0a-9a8c-bff52e823db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:49.813261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a308dc8-aa20-4a0a-9a8c-bff52e823db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:49.813707 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a308dc8-aa20-4a0a-9a8c-bff52e823db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:49.813997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a308dc8-aa20-4a0a-9a8c-bff52e823db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:49.814782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a308dc8-aa20-4a0a-9a8c-bff52e823db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:49.816833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a308dc8-aa20-4a0a-9a8c-bff52e823db2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:49.843178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 980/1957] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:49 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:49.848260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ec4f1-830c-4761-80c7-60b51a0edc8d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:49.858189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ec4f1-830c-4761-80c7-60b51a0edc8d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:49.884743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:49.919087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361932d-86b8-4a43-a0b1-77c2ffa5459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:49.919914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361932d-86b8-4a43-a0b1-77c2ffa5459c admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:49.920137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361932d-86b8-4a43-a0b1-77c2ffa5459c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:49.920418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361932d-86b8-4a43-a0b1-77c2ffa5459c admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:49.921109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361932d-86b8-4a43-a0b1-77c2ffa5459c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:49.923193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361932d-86b8-4a43-a0b1-77c2ffa5459c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:49.942634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 978/1958] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:49 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:49.946431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a308dc8-aa20-4a0a-9a8c-bff52e823db2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:49.957456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a308dc8-aa20-4a0a-9a8c-bff52e823db2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:49.962121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56962736-392d-453b-84b8-89625d0a9ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:49.962815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962736-392d-453b-84b8-89625d0a9ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:49.963102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962736-392d-453b-84b8-89625d0a9ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:49.963383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962736-392d-453b-84b8-89625d0a9ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:49.964109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56962736-392d-453b-84b8-89625d0a9ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:49.965766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56962736-392d-453b-84b8-89625d0a9ff1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:49.977269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 981/1959] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:49.981136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361932d-86b8-4a43-a0b1-77c2ffa5459c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:49.991432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361932d-86b8-4a43-a0b1-77c2ffa5459c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:49.996017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08fb1a-1671-45b9-91ab-62278d214650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:49.996685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08fb1a-1671-45b9-91ab-62278d214650 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:49.996968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08fb1a-1671-45b9-91ab-62278d214650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:49.997245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08fb1a-1671-45b9-91ab-62278d214650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:49.997967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08fb1a-1671-45b9-91ab-62278d214650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:49.999638 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08fb1a-1671-45b9-91ab-62278d214650 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:50.015303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 979/1960] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:50.020623 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56962736-392d-453b-84b8-89625d0a9ff1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:50.030782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56962736-392d-453b-84b8-89625d0a9ff1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:50.035546 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29516807-044c-4c9d-b15b-8ee795fa258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:50.036422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29516807-044c-4c9d-b15b-8ee795fa258a admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:50.036733 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29516807-044c-4c9d-b15b-8ee795fa258a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:50.037011 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29516807-044c-4c9d-b15b-8ee795fa258a admin admin] PATH_INFO: `/v3/projects/bdf6634373804a76b350132dc3fd59e4/users/e7163e2d28ba4db09b7de1052c6461ba/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:50.051406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29516807-044c-4c9d-b15b-8ee795fa258a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf6634373804a76b350132dc3fd59e4, user_id=e7163e2d28ba4db09b7de1052c6461ba, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:50.054055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29516807-044c-4c9d-b15b-8ee795fa258a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:50.072158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 982/1961] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:50 2022] PUT /identity/v3/projects/bdf6634373804a76b350132dc3fd59e4/users/e7163e2d28ba4db09b7de1052c6461ba/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:50.083030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e072b0-497a-4e85-9bb0-45ea648a9e6c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:50.083327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e072b0-497a-4e85-9bb0-45ea648a9e6c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:50.083608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e072b0-497a-4e85-9bb0-45ea648a9e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:50.110888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-24e072b0-497a-4e85-9bb0-45ea648a9e6c None None] MFA Rules not processed for user `e7163e2d28ba4db09b7de1052c6461ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:50.112129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-24e072b0-497a-4e85-9bb0-45ea648a9e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:50.180062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 980/1962] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:50.191714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29516807-044c-4c9d-b15b-8ee795fa258a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:50.193409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-29516807-044c-4c9d-b15b-8ee795fa258a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:50.261501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29516807-044c-4c9d-b15b-8ee795fa258a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:50.265178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870b358-2710-4141-803c-08ddbc9a682d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:50.266523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870b358-2710-4141-803c-08ddbc9a682d service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:50.266925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870b358-2710-4141-803c-08ddbc9a682d service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:50.267215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870b358-2710-4141-803c-08ddbc9a682d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:50.276334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870b358-2710-4141-803c-08ddbc9a682d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:50.277791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870b358-2710-4141-803c-08ddbc9a682d service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:50.287175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 983/1963] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:50.306603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e072b0-497a-4e85-9bb0-45ea648a9e6c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:50.385032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e072b0-497a-4e85-9bb0-45ea648a9e6c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:50.390104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:50.391059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:50.391535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:50.395677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] PATH_INFO: `/v3/users/e7163e2d28ba4db09b7de1052c6461ba` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:50.395677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7163e2d28ba4db09b7de1052c6461ba)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:50.395677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:50.439886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:50.447290 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7163e2d28ba4db09b7de1052c6461ba'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:50.449420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7163e2d28ba4db09b7de1052c6461ba'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:50.455995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7163e2d28ba4db09b7de1052c6461ba'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:50.456664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7163e2d28ba4db09b7de1052c6461ba'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:50.468339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7163e2d28ba4db09b7de1052c6461ba'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:50.481575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 981/1964] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:08:50 2022] DELETE /identity/v3/users/e7163e2d28ba4db09b7de1052c6461ba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:50.486795 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039e5a-9426-4fc1-871d-5f4ccb06bbfc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:50.487296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039e5a-9426-4fc1-871d-5f4ccb06bbfc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:50.487579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039e5a-9426-4fc1-871d-5f4ccb06bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:50.505418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f3039e5a-9426-4fc1-871d-5f4ccb06bbfc None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:50.506908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f3039e5a-9426-4fc1-871d-5f4ccb06bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:50.570463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 984/1965] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:50.583252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:50.584642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:50.646089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960804b4-9588-4a1d-8e2e-9618bac80f57 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:50.649704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24796c-67c5-43d9-9cd2-07d063575856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:50.650347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24796c-67c5-43d9-9cd2-07d063575856 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:50.650631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24796c-67c5-43d9-9cd2-07d063575856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:50.650948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24796c-67c5-43d9-9cd2-07d063575856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:50.660228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24796c-67c5-43d9-9cd2-07d063575856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:50.661657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24796c-67c5-43d9-9cd2-07d063575856 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:50.670962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 982/1966] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:08:51.019740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039e5a-9426-4fc1-871d-5f4ccb06bbfc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.021467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f3039e5a-9426-4fc1-871d-5f4ccb06bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:51.034908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039e5a-9426-4fc1-871d-5f4ccb06bbfc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.039605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.040564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.040909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.041246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] PATH_INFO: `/v3/projects/bdf6634373804a76b350132dc3fd59e4` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.042494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf6634373804a76b350132dc3fd59e4)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.044759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.046462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:51.099689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf6634373804a76b350132dc3fd59e4', 'request_id': 'req-f06c0a4f-67f0-4154-8c14-91abefdbdbea'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:51.107602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf6634373804a76b350132dc3fd59e4', 'request_id': 'req-f06c0a4f-67f0-4154-8c14-91abefdbdbea'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:51.115309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf6634373804a76b350132dc3fd59e4', 'request_id': 'req-f06c0a4f-67f0-4154-8c14-91abefdbdbea'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:51.126450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] The token cache is being invalidate because project bdf6634373804a76b350132dc3fd59e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:08:51.126753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:51.127410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f06c0a4f-67f0-4154-8c14-91abefdbdbea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:08:51.129331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 985/1967] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:08:51 2022] DELETE /identity/v3/projects/bdf6634373804a76b350132dc3fd59e4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:51.134389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0b37-d4db-42b6-9af8-9dfe41023c32 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.134890 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0b37-d4db-42b6-9af8-9dfe41023c32 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.135054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0b37-d4db-42b6-9af8-9dfe41023c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.153557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-872a0b37-d4db-42b6-9af8-9dfe41023c32 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:51.154781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-872a0b37-d4db-42b6-9af8-9dfe41023c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:51.218263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 983/1968] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:08:51.227591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f95fbb-741d-4e99-aa12-485c64c77670 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.227882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f95fbb-741d-4e99-aa12-485c64c77670 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.228162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f95fbb-741d-4e99-aa12-485c64c77670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.247063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-16f95fbb-741d-4e99-aa12-485c64c77670 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:51.248276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-16f95fbb-741d-4e99-aa12-485c64c77670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:51.256954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 986/1969] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:51.261519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0b37-d4db-42b6-9af8-9dfe41023c32 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.271930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0b37-d4db-42b6-9af8-9dfe41023c32 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.277150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24974b76-84a1-46c9-a707-2be35f268b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.277381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24974b76-84a1-46c9-a707-2be35f268b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.277823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24974b76-84a1-46c9-a707-2be35f268b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.278205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24974b76-84a1-46c9-a707-2be35f268b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.279177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24974b76-84a1-46c9-a707-2be35f268b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:08:51.279605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24974b76-84a1-46c9-a707-2be35f268b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.281329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24974b76-84a1-46c9-a707-2be35f268b9d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.294461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 984/1970] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:08:51.298925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f95fbb-741d-4e99-aa12-485c64c77670 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.308263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f95fbb-741d-4e99-aa12-485c64c77670 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.312976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ccb79-c231-441a-8ef0-5e17e5791eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.313720 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ccb79-c231-441a-8ef0-5e17e5791eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.314001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ccb79-c231-441a-8ef0-5e17e5791eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.314278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ccb79-c231-441a-8ef0-5e17e5791eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.315003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ccb79-c231-441a-8ef0-5e17e5791eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.316905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ccb79-c231-441a-8ef0-5e17e5791eb2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.350296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 987/1971] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:51 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:51.351735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24974b76-84a1-46c9-a707-2be35f268b9d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.362595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24974b76-84a1-46c9-a707-2be35f268b9d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.408872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:51.422812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf209d0d-ec62-4a44-9c65-77551d174c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.423462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf209d0d-ec62-4a44-9c65-77551d174c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.423743 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf209d0d-ec62-4a44-9c65-77551d174c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.424016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf209d0d-ec62-4a44-9c65-77551d174c3f admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.424698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf209d0d-ec62-4a44-9c65-77551d174c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.426590 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf209d0d-ec62-4a44-9c65-77551d174c3f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.446205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 985/1972] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:51 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:51.450356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ccb79-c231-441a-8ef0-5e17e5791eb2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.461228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ccb79-c231-441a-8ef0-5e17e5791eb2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.465896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc5240-dbc7-4370-952f-b23d092706d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.466549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc5240-dbc7-4370-952f-b23d092706d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.466875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc5240-dbc7-4370-952f-b23d092706d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.467155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc5240-dbc7-4370-952f-b23d092706d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.467877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc5240-dbc7-4370-952f-b23d092706d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.470365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc5240-dbc7-4370-952f-b23d092706d8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.481094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 988/1973] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:51.484942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf209d0d-ec62-4a44-9c65-77551d174c3f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.494428 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf209d0d-ec62-4a44-9c65-77551d174c3f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.498984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe104e-6745-459d-b842-cb10f6a154f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.499640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe104e-6745-459d-b842-cb10f6a154f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.499925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe104e-6745-459d-b842-cb10f6a154f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.500689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe104e-6745-459d-b842-cb10f6a154f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.501515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe104e-6745-459d-b842-cb10f6a154f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.503171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe104e-6745-459d-b842-cb10f6a154f7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.513331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 986/1974] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:51.517536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc5240-dbc7-4370-952f-b23d092706d8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.528071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc5240-dbc7-4370-952f-b23d092706d8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.533759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c01b48-f23d-4682-be46-310fb368e253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.534635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01b48-f23d-4682-be46-310fb368e253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.534947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01b48-f23d-4682-be46-310fb368e253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.535223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01b48-f23d-4682-be46-310fb368e253 admin admin] PATH_INFO: `/v3/projects/d8c24eb46c9e41b398c5520131af44e9/users/ff6f371bc3e24cf5baa17095ed2496e4/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.550371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c01b48-f23d-4682-be46-310fb368e253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c24eb46c9e41b398c5520131af44e9, user_id=ff6f371bc3e24cf5baa17095ed2496e4, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.553076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c01b48-f23d-4682-be46-310fb368e253 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.565899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 989/1975] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:51 2022] PUT /identity/v3/projects/d8c24eb46c9e41b398c5520131af44e9/users/ff6f371bc3e24cf5baa17095ed2496e4/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:51.575842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f167e06-bd62-4c24-a444-f99bb016d4bb None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.576328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f167e06-bd62-4c24-a444-f99bb016d4bb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.576611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f167e06-bd62-4c24-a444-f99bb016d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.603357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8f167e06-bd62-4c24-a444-f99bb016d4bb None None] MFA Rules not processed for user `ff6f371bc3e24cf5baa17095ed2496e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:51.604552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8f167e06-bd62-4c24-a444-f99bb016d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:51.679956 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 987/1976] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:51.680271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c01b48-f23d-4682-be46-310fb368e253 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.750067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c01b48-f23d-4682-be46-310fb368e253 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.754784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32177e67-e0e7-4d5b-8e8e-88581a80bb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.755477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32177e67-e0e7-4d5b-8e8e-88581a80bb8a admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.756864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32177e67-e0e7-4d5b-8e8e-88581a80bb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.756864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32177e67-e0e7-4d5b-8e8e-88581a80bb8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.756864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32177e67-e0e7-4d5b-8e8e-88581a80bb8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.759410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32177e67-e0e7-4d5b-8e8e-88581a80bb8a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.789740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 990/1977] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:51 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:08:51.793694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f167e06-bd62-4c24-a444-f99bb016d4bb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.805001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f167e06-bd62-4c24-a444-f99bb016d4bb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.858859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3087274-d990-49e6-a9ed-5e1542248ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.860143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3087274-d990-49e6-a9ed-5e1542248ede admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.860427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3087274-d990-49e6-a9ed-5e1542248ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.860710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3087274-d990-49e6-a9ed-5e1542248ede admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.861393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3087274-d990-49e6-a9ed-5e1542248ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.863338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3087274-d990-49e6-a9ed-5e1542248ede admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.881560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 988/1978] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:51 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:51.885875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32177e67-e0e7-4d5b-8e8e-88581a80bb8a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.896451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32177e67-e0e7-4d5b-8e8e-88581a80bb8a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.900942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18066-cadc-430a-a21d-afaee8ca5fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.901590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18066-cadc-430a-a21d-afaee8ca5fab admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.901874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18066-cadc-430a-a21d-afaee8ca5fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.902152 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18066-cadc-430a-a21d-afaee8ca5fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.902895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a18066-cadc-430a-a21d-afaee8ca5fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.904468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a18066-cadc-430a-a21d-afaee8ca5fab admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.910196 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:51.916027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 991/1979] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:51.919797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3087274-d990-49e6-a9ed-5e1542248ede admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.929880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3087274-d990-49e6-a9ed-5e1542248ede admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.934603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a4b58-60f6-48af-a479-8e93e3904155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.935283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a4b58-60f6-48af-a479-8e93e3904155 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.935572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a4b58-60f6-48af-a479-8e93e3904155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.935846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a4b58-60f6-48af-a479-8e93e3904155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.936560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a4b58-60f6-48af-a479-8e93e3904155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.938222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a4b58-60f6-48af-a479-8e93e3904155 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.948010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 989/1980] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:08:51.952034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18066-cadc-430a-a21d-afaee8ca5fab admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:51.962106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18066-cadc-430a-a21d-afaee8ca5fab admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:51.966629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b8023-470e-422a-9ab5-61e882977a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:51.967533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8023-470e-422a-9ab5-61e882977a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:51.967812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8023-470e-422a-9ab5-61e882977a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:51.968085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8023-470e-422a-9ab5-61e882977a3a admin admin] PATH_INFO: `/v3/projects/a6c9cbb9ee874a108df8efc2ecfd8cd5/users/5a882953397a4a25982a526a2b0aa539/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:51.982693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b8023-470e-422a-9ab5-61e882977a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c9cbb9ee874a108df8efc2ecfd8cd5, user_id=5a882953397a4a25982a526a2b0aa539, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:51.985679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b8023-470e-422a-9ab5-61e882977a3a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:51.998160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 992/1981] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:51 2022] PUT /identity/v3/projects/a6c9cbb9ee874a108df8efc2ecfd8cd5/users/5a882953397a4a25982a526a2b0aa539/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:08:52.008606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0cb88-6b33-4534-afc1-3f224c83b918 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:52.008895 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0cb88-6b33-4534-afc1-3f224c83b918 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:52.009179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0cb88-6b33-4534-afc1-3f224c83b918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:52.038507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-36f0cb88-6b33-4534-afc1-3f224c83b918 None None] MFA Rules not processed for user `5a882953397a4a25982a526a2b0aa539`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:52.039734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-36f0cb88-6b33-4534-afc1-3f224c83b918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:52.059762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:52.107261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 990/1982] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:52.111976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b8023-470e-422a-9ab5-61e882977a3a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:52.178279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b8023-470e-422a-9ab5-61e882977a3a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:52.183078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cc25e-b60e-4384-867a-01318bbda1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:52.183739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cc25e-b60e-4384-867a-01318bbda1bc admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:52.184088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cc25e-b60e-4384-867a-01318bbda1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:52.184372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cc25e-b60e-4384-867a-01318bbda1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:52.185090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cc25e-b60e-4384-867a-01318bbda1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:52.187015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cc25e-b60e-4384-867a-01318bbda1bc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:52.213331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 993/1983] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:08:52 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:52.217362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0cb88-6b33-4534-afc1-3f224c83b918 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:52.229364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0cb88-6b33-4534-afc1-3f224c83b918 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:52.286996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02a9ba-91f0-4136-b56c-f02e8b7b71bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:52.287584 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02a9ba-91f0-4136-b56c-f02e8b7b71bd admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:52.287872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02a9ba-91f0-4136-b56c-f02e8b7b71bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:52.288172 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02a9ba-91f0-4136-b56c-f02e8b7b71bd admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:52.288852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02a9ba-91f0-4136-b56c-f02e8b7b71bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:52.290866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02a9ba-91f0-4136-b56c-f02e8b7b71bd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:52.313458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 991/1984] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:08:52 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:08:52.317597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cc25e-b60e-4384-867a-01318bbda1bc admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:52.329123 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cc25e-b60e-4384-867a-01318bbda1bc admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:52.334116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24989d62-66b3-4970-b013-6599099c5fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:52.334825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24989d62-66b3-4970-b013-6599099c5fad admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:52.335109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24989d62-66b3-4970-b013-6599099c5fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:52.335385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24989d62-66b3-4970-b013-6599099c5fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:52.336141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24989d62-66b3-4970-b013-6599099c5fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:52.337728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24989d62-66b3-4970-b013-6599099c5fad admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:52.349995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 994/1985] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:52.354549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02a9ba-91f0-4136-b56c-f02e8b7b71bd admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:52.366551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02a9ba-91f0-4136-b56c-f02e8b7b71bd admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:52.372622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353827d6-70ca-41c4-8266-ab93b481e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:52.373710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353827d6-70ca-41c4-8266-ab93b481e0af admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:52.374168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353827d6-70ca-41c4-8266-ab93b481e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:52.375694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353827d6-70ca-41c4-8266-ab93b481e0af admin admin] PATH_INFO: `/v3/projects/cb771cbf583a4c8e8fdd7a82141998e5/users/6f6960d4f3d94d6ba7e5c79c4e5cf35e/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:52.397595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353827d6-70ca-41c4-8266-ab93b481e0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb771cbf583a4c8e8fdd7a82141998e5, user_id=6f6960d4f3d94d6ba7e5c79c4e5cf35e, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:52.401606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353827d6-70ca-41c4-8266-ab93b481e0af admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:52.418326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 992/1986] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:52 2022] PUT /identity/v3/projects/cb771cbf583a4c8e8fdd7a82141998e5/users/6f6960d4f3d94d6ba7e5c79c4e5cf35e/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:52.423189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24989d62-66b3-4970-b013-6599099c5fad admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:52.434323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24989d62-66b3-4970-b013-6599099c5fad admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:52.508371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61e356-beca-4fd8-a88f-912e8de8f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:52.514093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61e356-beca-4fd8-a88f-912e8de8f1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:52.514093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61e356-beca-4fd8-a88f-912e8de8f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:52.514093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61e356-beca-4fd8-a88f-912e8de8f1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:52.514093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61e356-beca-4fd8-a88f-912e8de8f1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:52.514093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61e356-beca-4fd8-a88f-912e8de8f1ca admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:52.528928 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 995/1987] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:08:52.530036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353827d6-70ca-41c4-8266-ab93b481e0af admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:52.541042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353827d6-70ca-41c4-8266-ab93b481e0af admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:52.546392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2577fc5-337f-424c-8abe-3d74a0ea4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:52.547479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2577fc5-337f-424c-8abe-3d74a0ea4a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:52.547661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2577fc5-337f-424c-8abe-3d74a0ea4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:52.548069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2577fc5-337f-424c-8abe-3d74a0ea4a8a admin admin] PATH_INFO: `/v3/projects/cb771cbf583a4c8e8fdd7a82141998e5/users/6f6960d4f3d94d6ba7e5c79c4e5cf35e/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:52.550171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2577fc5-337f-424c-8abe-3d74a0ea4a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb771cbf583a4c8e8fdd7a82141998e5, user_id=6f6960d4f3d94d6ba7e5c79c4e5cf35e, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:52.552981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2577fc5-337f-424c-8abe-3d74a0ea4a8a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:52.564541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 993/1988] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:08:52 2022] PUT /identity/v3/projects/cb771cbf583a4c8e8fdd7a82141998e5/users/6f6960d4f3d94d6ba7e5c79c4e5cf35e/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:08:52.575584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6d19b-5529-4a4f-aec5-1f9e41fd2392 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:52.575874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6d19b-5529-4a4f-aec5-1f9e41fd2392 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:52.576149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6d19b-5529-4a4f-aec5-1f9e41fd2392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:52.603146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c7a6d19b-5529-4a4f-aec5-1f9e41fd2392 None None] MFA Rules not processed for user `6f6960d4f3d94d6ba7e5c79c4e5cf35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:08:52.604330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c7a6d19b-5529-4a4f-aec5-1f9e41fd2392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:52.638388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:52.672967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 996/1989] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:08:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:08:52.684052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2577fc5-337f-424c-8abe-3d74a0ea4a8a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:08:52.685832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c2577fc5-337f-424c-8abe-3d74a0ea4a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:08:52.747016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2577fc5-337f-424c-8abe-3d74a0ea4a8a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:08:52.751214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e0dc0-d400-410b-ae5d-c2191a6e4344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:08:52.751861 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e0dc0-d400-410b-ae5d-c2191a6e4344 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:08:52.752145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e0dc0-d400-410b-ae5d-c2191a6e4344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:08:52.752422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e0dc0-d400-410b-ae5d-c2191a6e4344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:08:52.783769 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:08:52.823639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e0dc0-d400-410b-ae5d-c2191a6e4344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:08:52.825159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e0dc0-d400-410b-ae5d-c2191a6e4344 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:08:52.834671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 994/1990] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:08:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:02.621124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6d19b-5529-4a4f-aec5-1f9e41fd2392 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:02.622966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c7a6d19b-5529-4a4f-aec5-1f9e41fd2392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:02.728430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6d19b-5529-4a4f-aec5-1f9e41fd2392 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:02.734111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:02.735992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:02.736429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:02.736964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] PATH_INFO: `/v3/users/16ffa16c98164c2399fcd3135bedb3cb` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:02.738326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ffa16c98164c2399fcd3135bedb3cb)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:02.741407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:02.811183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ffa16c98164c2399fcd3135bedb3cb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:02.823787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ffa16c98164c2399fcd3135bedb3cb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:02.824705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ffa16c98164c2399fcd3135bedb3cb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:02.825595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ffa16c98164c2399fcd3135bedb3cb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:02.830087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=14 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:02.841751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-533fbeb3-a282-45b6-8eb5-06c6dca77012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ffa16c98164c2399fcd3135bedb3cb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:02.862419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 997/1991] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:02 2022] DELETE /identity/v3/users/16ffa16c98164c2399fcd3135bedb3cb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:02.863316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e0dc0-d400-410b-ae5d-c2191a6e4344 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:02.866809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896805b7-a33d-409e-80cc-858a33a28150 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:02.867181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896805b7-a33d-409e-80cc-858a33a28150 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:02.867536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896805b7-a33d-409e-80cc-858a33a28150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:02.876976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e0dc0-d400-410b-ae5d-c2191a6e4344 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:02.893723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-896805b7-a33d-409e-80cc-858a33a28150 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:02.896111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-896805b7-a33d-409e-80cc-858a33a28150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:02.947203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4842a6-457a-4fc9-92a1-a110812dbf2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:02.948566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4842a6-457a-4fc9-92a1-a110812dbf2b service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:02.949333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4842a6-457a-4fc9-92a1-a110812dbf2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:02.949712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4842a6-457a-4fc9-92a1-a110812dbf2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:02.951964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2e4842a6-457a-4fc9-92a1-a110812dbf2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:02.956607 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:02.979178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 998/1992] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:02.985637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896805b7-a33d-409e-80cc-858a33a28150 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:02.987188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-896805b7-a33d-409e-80cc-858a33a28150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:03.030975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4842a6-457a-4fc9-92a1-a110812dbf2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:03.032708 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4842a6-457a-4fc9-92a1-a110812dbf2b service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:03.043003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 995/1993] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:09:03.050543 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896805b7-a33d-409e-80cc-858a33a28150 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:03.054581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f2daa-e9e6-41e9-b015-f485d5167fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:03.055493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2daa-e9e6-41e9-b015-f485d5167fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.055909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2daa-e9e6-41e9-b015-f485d5167fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.057066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2daa-e9e6-41e9-b015-f485d5167fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.067391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f2daa-e9e6-41e9-b015-f485d5167fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:03.068916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f2daa-e9e6-41e9-b015-f485d5167fb2 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:03.082345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 999/1994] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:09:03.386086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4842a6-457a-4fc9-92a1-a110812dbf2b service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:03.387813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2e4842a6-457a-4fc9-92a1-a110812dbf2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:03.404450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4842a6-457a-4fc9-92a1-a110812dbf2b service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:03.412098 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:03.413202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.413562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.413939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] PATH_INFO: `/v3/projects/5e8cda5fc6e54d03b25361502eeffc94` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.415691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8cda5fc6e54d03b25361502eeffc94)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:03.417675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:03.475179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8cda5fc6e54d03b25361502eeffc94', 'request_id': 'req-483c8911-c51e-448d-ada0-4a67da19a9cd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:03.484950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8cda5fc6e54d03b25361502eeffc94', 'request_id': 'req-483c8911-c51e-448d-ada0-4a67da19a9cd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:03.490765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8cda5fc6e54d03b25361502eeffc94', 'request_id': 'req-483c8911-c51e-448d-ada0-4a67da19a9cd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:03.502967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] The token cache is being invalidate because project 5e8cda5fc6e54d03b25361502eeffc94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:03.503269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:03.503957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-483c8911-c51e-448d-ada0-4a67da19a9cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:03.505897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 996/1995] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:03 2022] DELETE /identity/v3/projects/5e8cda5fc6e54d03b25361502eeffc94 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:03.511202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086baf-a9e4-43d6-a6e4-f9db5fb22fae None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.511495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086baf-a9e4-43d6-a6e4-f9db5fb22fae None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.511820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e086baf-a9e4-43d6-a6e4-f9db5fb22fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.534278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9e086baf-a9e4-43d6-a6e4-f9db5fb22fae None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:03.535501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9e086baf-a9e4-43d6-a6e4-f9db5fb22fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:03.595447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1000/1996] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:03.603372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ada63-db2a-405d-8be3-47b34c4cc8d4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.603668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ada63-db2a-405d-8be3-47b34c4cc8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.603948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ada63-db2a-405d-8be3-47b34c4cc8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.622800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e19ada63-db2a-405d-8be3-47b34c4cc8d4 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:03.623995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e19ada63-db2a-405d-8be3-47b34c4cc8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:03.632337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 997/1997] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:03.636716 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e086baf-a9e4-43d6-a6e4-f9db5fb22fae None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:03.646472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e086baf-a9e4-43d6-a6e4-f9db5fb22fae None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:03.650981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e3d65-09a4-4ff3-a9df-898f8be21adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:03.651663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e3d65-09a4-4ff3-a9df-898f8be21adf admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.651945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e3d65-09a4-4ff3-a9df-898f8be21adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.652220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e3d65-09a4-4ff3-a9df-898f8be21adf admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.652939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e3d65-09a4-4ff3-a9df-898f8be21adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:03.653243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e3d65-09a4-4ff3-a9df-898f8be21adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:03.654873 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e3d65-09a4-4ff3-a9df-898f8be21adf admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:03.666829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1001/1998] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:09:03.670959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ada63-db2a-405d-8be3-47b34c4cc8d4 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:03.681115 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ada63-db2a-405d-8be3-47b34c4cc8d4 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:03.685779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b68258-ee98-44a3-a2ef-7b736045a9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:03.686462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b68258-ee98-44a3-a2ef-7b736045a9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.686780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b68258-ee98-44a3-a2ef-7b736045a9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.687148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b68258-ee98-44a3-a2ef-7b736045a9d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.687741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b68258-ee98-44a3-a2ef-7b736045a9d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:03.689660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b68258-ee98-44a3-a2ef-7b736045a9d8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:03.714793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 998/1999] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:03 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:03.719826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e3d65-09a4-4ff3-a9df-898f8be21adf admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:03.736053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e3d65-09a4-4ff3-a9df-898f8be21adf admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:03.792607 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c22f6-c9a5-49e2-84ef-72ba7d8bd779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:03.793193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c22f6-c9a5-49e2-84ef-72ba7d8bd779 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.793471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c22f6-c9a5-49e2-84ef-72ba7d8bd779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.793741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c22f6-c9a5-49e2-84ef-72ba7d8bd779 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.794437 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c22f6-c9a5-49e2-84ef-72ba7d8bd779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:03.796412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c22f6-c9a5-49e2-84ef-72ba7d8bd779 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:03.816788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1002/2000] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:03 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:03.821217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b68258-ee98-44a3-a2ef-7b736045a9d8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:03.832245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b68258-ee98-44a3-a2ef-7b736045a9d8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:03.836880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474400b-dd14-4a5b-86be-e8860261a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:03.837534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474400b-dd14-4a5b-86be-e8860261a650 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.837817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474400b-dd14-4a5b-86be-e8860261a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.838090 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474400b-dd14-4a5b-86be-e8860261a650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.838845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474400b-dd14-4a5b-86be-e8860261a650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:03.840548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474400b-dd14-4a5b-86be-e8860261a650 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:03.842590 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:03.854060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 999/2001] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:03.857602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c22f6-c9a5-49e2-84ef-72ba7d8bd779 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:03.868218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c22f6-c9a5-49e2-84ef-72ba7d8bd779 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:03.872803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eaa89-a335-4179-8ae7-a320449498f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:03.873456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eaa89-a335-4179-8ae7-a320449498f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.873739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eaa89-a335-4179-8ae7-a320449498f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.874017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eaa89-a335-4179-8ae7-a320449498f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.874873 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eaa89-a335-4179-8ae7-a320449498f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:03.876463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eaa89-a335-4179-8ae7-a320449498f0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:03.881630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:03.888449 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1003/2002] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:03.892787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474400b-dd14-4a5b-86be-e8860261a650 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:03.902610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474400b-dd14-4a5b-86be-e8860261a650 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:03.907896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fb5a7-393c-48e3-8438-ceebf20379eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:03.908768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb5a7-393c-48e3-8438-ceebf20379eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.909050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb5a7-393c-48e3-8438-ceebf20379eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.909373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb5a7-393c-48e3-8438-ceebf20379eb admin admin] PATH_INFO: `/v3/projects/509113985e9246389c89f15fde5c4b40/users/3a02a98ba32848bb8a7b935fbff8c76f/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.924149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fb5a7-393c-48e3-8438-ceebf20379eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=509113985e9246389c89f15fde5c4b40, user_id=3a02a98ba32848bb8a7b935fbff8c76f, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:03.926693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fb5a7-393c-48e3-8438-ceebf20379eb admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:03.939724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1000/2003] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:03 2022] PUT /identity/v3/projects/509113985e9246389c89f15fde5c4b40/users/3a02a98ba32848bb8a7b935fbff8c76f/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:03.949611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419006b-68ec-40aa-b2d6-f8ec80f7120b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:03.949947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419006b-68ec-40aa-b2d6-f8ec80f7120b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:03.950275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419006b-68ec-40aa-b2d6-f8ec80f7120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:03.980540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1419006b-68ec-40aa-b2d6-f8ec80f7120b None None] MFA Rules not processed for user `3a02a98ba32848bb8a7b935fbff8c76f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:03.981749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1419006b-68ec-40aa-b2d6-f8ec80f7120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:04.049057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1004/2004] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:04.060060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fb5a7-393c-48e3-8438-ceebf20379eb admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:04.061749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6d0fb5a7-393c-48e3-8438-ceebf20379eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:04.123996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fb5a7-393c-48e3-8438-ceebf20379eb admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:04.127951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0de9-2518-46ad-b58f-3de88fc06839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:04.128602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0de9-2518-46ad-b58f-3de88fc06839 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:04.128890 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0de9-2518-46ad-b58f-3de88fc06839 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:04.129169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0de9-2518-46ad-b58f-3de88fc06839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:04.138337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b0de9-2518-46ad-b58f-3de88fc06839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:04.139979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b0de9-2518-46ad-b58f-3de88fc06839 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:04.152454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1001/2005] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:04.436391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419006b-68ec-40aa-b2d6-f8ec80f7120b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:04.438069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1419006b-68ec-40aa-b2d6-f8ec80f7120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:04.451460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419006b-68ec-40aa-b2d6-f8ec80f7120b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:04.457537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e441bbf-15ff-4387-8d03-f7d6a5cd6d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:04.458412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441bbf-15ff-4387-8d03-f7d6a5cd6d6b service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:04.458829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441bbf-15ff-4387-8d03-f7d6a5cd6d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:04.459208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441bbf-15ff-4387-8d03-f7d6a5cd6d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:04.461168 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3e441bbf-15ff-4387-8d03-f7d6a5cd6d6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:04.556422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e441bbf-15ff-4387-8d03-f7d6a5cd6d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:04.557898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e441bbf-15ff-4387-8d03-f7d6a5cd6d6b service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:04.568086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1005/2006] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:14.145673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:14.563746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=62 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:23.308515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0de9-2518-46ad-b58f-3de88fc06839 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:23.310036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-918b0de9-2518-46ad-b58f-3de88fc06839 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:23.395425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0de9-2518-46ad-b58f-3de88fc06839 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:23.400827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:23.401725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:23.402010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:23.402285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] PATH_INFO: `/v3/users/ff6f371bc3e24cf5baa17095ed2496e4` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:23.403528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6f371bc3e24cf5baa17095ed2496e4)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:23.405457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:23.474753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6f371bc3e24cf5baa17095ed2496e4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:23.475552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6f371bc3e24cf5baa17095ed2496e4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:23.486569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6f371bc3e24cf5baa17095ed2496e4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:23.487155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6f371bc3e24cf5baa17095ed2496e4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:23.515284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6f371bc3e24cf5baa17095ed2496e4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:23.547653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1002/2007] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:23 2022] DELETE /identity/v3/users/ff6f371bc3e24cf5baa17095ed2496e4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:23.552751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86c991-5f01-48fe-9fc0-6107efb189eb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:23.553280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86c991-5f01-48fe-9fc0-6107efb189eb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:23.553458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86c991-5f01-48fe-9fc0-6107efb189eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:23.588466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fe86c991-5f01-48fe-9fc0-6107efb189eb None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:23.589680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fe86c991-5f01-48fe-9fc0-6107efb189eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:23.689222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1006/2008] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:23.701108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:23.702664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:23.807548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866b73e-0397-4931-a08c-73129c1cd536 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:23.811608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f788f9-d82c-4df0-9428-6b517d2ec140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:23.813127 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f788f9-d82c-4df0-9428-6b517d2ec140 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:23.813477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f788f9-d82c-4df0-9428-6b517d2ec140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:23.813761 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f788f9-d82c-4df0-9428-6b517d2ec140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:23.831661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f788f9-d82c-4df0-9428-6b517d2ec140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:23.833553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f788f9-d82c-4df0-9428-6b517d2ec140 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:23.849738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1003/2009] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:24.111540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86c991-5f01-48fe-9fc0-6107efb189eb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:24.116207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fe86c991-5f01-48fe-9fc0-6107efb189eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:24.136451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86c991-5f01-48fe-9fc0-6107efb189eb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:24.155472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:24.156625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:24.157097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:24.157611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] PATH_INFO: `/v3/users/3a02a98ba32848bb8a7b935fbff8c76f` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:24.159588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a02a98ba32848bb8a7b935fbff8c76f)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:24.161579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:24.238915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a02a98ba32848bb8a7b935fbff8c76f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.256954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a02a98ba32848bb8a7b935fbff8c76f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.267947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a02a98ba32848bb8a7b935fbff8c76f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.268119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a02a98ba32848bb8a7b935fbff8c76f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.285030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a02a98ba32848bb8a7b935fbff8c76f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.301739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1007/2010] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:24 2022] DELETE /identity/v3/users/3a02a98ba32848bb8a7b935fbff8c76f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:24.306326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06491a-fe76-43f1-b5ac-4285179bb9bb None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:24.306636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06491a-fe76-43f1-b5ac-4285179bb9bb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:24.307049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06491a-fe76-43f1-b5ac-4285179bb9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:24.329819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1e06491a-fe76-43f1-b5ac-4285179bb9bb None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:24.331119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1e06491a-fe76-43f1-b5ac-4285179bb9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:24.340656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:24.342381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:24.370630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:24.429716 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270298c3-d4a7-4c59-b6f7-a081f9a24fda admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:24.433477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1004/2011] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:24.438207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:24.439216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:24.439930 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:24.440371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] PATH_INFO: `/v3/projects/d8c24eb46c9e41b398c5520131af44e9` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:24.440850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06491a-fe76-43f1-b5ac-4285179bb9bb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:24.441626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c24eb46c9e41b398c5520131af44e9)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:24.442319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1e06491a-fe76-43f1-b5ac-4285179bb9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:24.443596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:24.469109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:24.512064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06491a-fe76-43f1-b5ac-4285179bb9bb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:24.524675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c24eb46c9e41b398c5520131af44e9', 'request_id': 'req-20031228-10a9-4b5c-93b8-d5be5760730a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.535146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c24eb46c9e41b398c5520131af44e9', 'request_id': 'req-20031228-10a9-4b5c-93b8-d5be5760730a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.546309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c24eb46c9e41b398c5520131af44e9', 'request_id': 'req-20031228-10a9-4b5c-93b8-d5be5760730a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.565078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] The token cache is being invalidate because project d8c24eb46c9e41b398c5520131af44e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:24.565630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.566091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.571504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1008/2012] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:24 2022] DELETE /identity/v3/projects/d8c24eb46c9e41b398c5520131af44e9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:24.571655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:24.572959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:24.592250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cdb76-2878-4a7d-9c39-1f75fa7a647e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:24.592901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cdb76-2878-4a7d-9c39-1f75fa7a647e service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:24.593181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cdb76-2878-4a7d-9c39-1f75fa7a647e service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:24.593454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cdb76-2878-4a7d-9c39-1f75fa7a647e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:24.595920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7f2cdb76-2878-4a7d-9c39-1f75fa7a647e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:24.643685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20031228-10a9-4b5c-93b8-d5be5760730a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:24.649201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:24.650183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:24.650460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:24.650761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] PATH_INFO: `/v3/users/5a882953397a4a25982a526a2b0aa539` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:24.652226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a882953397a4a25982a526a2b0aa539)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:24.654175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:24.665109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cdb76-2878-4a7d-9c39-1f75fa7a647e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:24.666842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cdb76-2878-4a7d-9c39-1f75fa7a647e service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:24.678884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1005/2013] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:09:24.709567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a882953397a4a25982a526a2b0aa539'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.717419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a882953397a4a25982a526a2b0aa539'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.718307 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a882953397a4a25982a526a2b0aa539'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.719709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a882953397a4a25982a526a2b0aa539'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.737025 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a882953397a4a25982a526a2b0aa539'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:24.753648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1009/2014] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:24 2022] DELETE /identity/v3/users/5a882953397a4a25982a526a2b0aa539 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:25.094850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cdb76-2878-4a7d-9c39-1f75fa7a647e service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.096364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7f2cdb76-2878-4a7d-9c39-1f75fa7a647e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:25.108836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cdb76-2878-4a7d-9c39-1f75fa7a647e service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:25.153806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:25.167063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.168508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:25.200771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:25.202150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.202511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.202996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] PATH_INFO: `/v3/projects/509113985e9246389c89f15fde5c4b40` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.204601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509113985e9246389c89f15fde5c4b40)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:25.206578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:25.210577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:25.258249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509113985e9246389c89f15fde5c4b40', 'request_id': 'req-7d5be9e3-4406-426b-a7df-9ed8e6339606'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.259809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d722010-c556-4122-9f44-43e85235c2e5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:25.269585 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509113985e9246389c89f15fde5c4b40', 'request_id': 'req-7d5be9e3-4406-426b-a7df-9ed8e6339606'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.276366 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509113985e9246389c89f15fde5c4b40', 'request_id': 'req-7d5be9e3-4406-426b-a7df-9ed8e6339606'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.289628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] The token cache is being invalidate because project 509113985e9246389c89f15fde5c4b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:25.289924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.290598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d5be9e3-4406-426b-a7df-9ed8e6339606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.296425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1006/2015] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:25 2022] DELETE /identity/v3/projects/509113985e9246389c89f15fde5c4b40 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:25.298928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0e68b-dcfa-4d9e-8086-2d23a79203aa None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.299220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0e68b-dcfa-4d9e-8086-2d23a79203aa None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.299504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0e68b-dcfa-4d9e-8086-2d23a79203aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.324391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:25.325161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5df0e68b-dcfa-4d9e-8086-2d23a79203aa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:25.325342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.325747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.326110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] PATH_INFO: `/v3/projects/a6c9cbb9ee874a108df8efc2ecfd8cd5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.326359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5df0e68b-dcfa-4d9e-8086-2d23a79203aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:25.327432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c9cbb9ee874a108df8efc2ecfd8cd5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:25.329950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:25.334874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1007/2016] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:25.342312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26759aec-fa4e-4198-b551-49c635d0c182 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.342597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26759aec-fa4e-4198-b551-49c635d0c182 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.342897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26759aec-fa4e-4198-b551-49c635d0c182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.363180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-26759aec-fa4e-4198-b551-49c635d0c182 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:25.364461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-26759aec-fa4e-4198-b551-49c635d0c182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:25.378675 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c9cbb9ee874a108df8efc2ecfd8cd5', 'request_id': 'req-a582943f-a571-4e6a-8e3d-49eec93a50c0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.387318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c9cbb9ee874a108df8efc2ecfd8cd5', 'request_id': 'req-a582943f-a571-4e6a-8e3d-49eec93a50c0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.396104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c9cbb9ee874a108df8efc2ecfd8cd5', 'request_id': 'req-a582943f-a571-4e6a-8e3d-49eec93a50c0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.409044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] The token cache is being invalidate because project a6c9cbb9ee874a108df8efc2ecfd8cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:25.409328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.410006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.411826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1010/2017] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:25 2022] DELETE /identity/v3/projects/a6c9cbb9ee874a108df8efc2ecfd8cd5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:25.415627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.416773 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:25.429877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1008/2018] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:25.433999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26759aec-fa4e-4198-b551-49c635d0c182 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.444021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26759aec-fa4e-4198-b551-49c635d0c182 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:25.449009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc5795-d5af-4596-8eb8-d76da03bbd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:25.449597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc5795-d5af-4596-8eb8-d76da03bbd1d admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.449885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc5795-d5af-4596-8eb8-d76da03bbd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.450167 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc5795-d5af-4596-8eb8-d76da03bbd1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.450919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc5795-d5af-4596-8eb8-d76da03bbd1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:25.451227 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc5795-d5af-4596-8eb8-d76da03bbd1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:25.452836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc5795-d5af-4596-8eb8-d76da03bbd1d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:25.464929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1009/2019] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:09:25.468932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc5795-d5af-4596-8eb8-d76da03bbd1d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.478629 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc5795-d5af-4596-8eb8-d76da03bbd1d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:25.483250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc391e1-4af6-414f-9196-270edd5c07c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:25.483913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc391e1-4af6-414f-9196-270edd5c07c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.484731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc391e1-4af6-414f-9196-270edd5c07c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.485202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc391e1-4af6-414f-9196-270edd5c07c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.485296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582943f-a571-4e6a-8e3d-49eec93a50c0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:25.485897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc391e1-4af6-414f-9196-270edd5c07c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:25.487820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc391e1-4af6-414f-9196-270edd5c07c5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:25.489902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:25.490800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.491088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.491387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] PATH_INFO: `/v3/users/6f6960d4f3d94d6ba7e5c79c4e5cf35e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.492595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6960d4f3d94d6ba7e5c79c4e5cf35e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:25.494563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:25.496088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:25.525621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1010/2020] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:25 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:25.529959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc391e1-4af6-414f-9196-270edd5c07c5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.554504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:25.558052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6960d4f3d94d6ba7e5c79c4e5cf35e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.572608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6960d4f3d94d6ba7e5c79c4e5cf35e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.574301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6960d4f3d94d6ba7e5c79c4e5cf35e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.575746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6960d4f3d94d6ba7e5c79c4e5cf35e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.596012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6960d4f3d94d6ba7e5c79c4e5cf35e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:25.611087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1011/2021] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:25 2022] DELETE /identity/v3/users/6f6960d4f3d94d6ba7e5c79c4e5cf35e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:25.615340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc391e1-4af6-414f-9196-270edd5c07c5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:25.674220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f768fe4-3b65-4066-a17a-dc307f148549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:25.674932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f768fe4-3b65-4066-a17a-dc307f148549 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.675365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f768fe4-3b65-4066-a17a-dc307f148549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.675648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f768fe4-3b65-4066-a17a-dc307f148549 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.676337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f768fe4-3b65-4066-a17a-dc307f148549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:25.678317 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f768fe4-3b65-4066-a17a-dc307f148549 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:25.698210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1011/2022] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:25 2022] POST /identity/v3/users => generated 281 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:25.702550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.703990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:25.717694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424f8e-461a-4a8d-86f4-cf0cfa0f6576 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:25.723142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec863bf-e2b2-4518-a1b6-c677e147892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:25.723815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec863bf-e2b2-4518-a1b6-c677e147892c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.724098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec863bf-e2b2-4518-a1b6-c677e147892c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.724373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec863bf-e2b2-4518-a1b6-c677e147892c admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.725098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec863bf-e2b2-4518-a1b6-c677e147892c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:25.726694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec863bf-e2b2-4518-a1b6-c677e147892c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:25.737598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1012/2023] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:25.741738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f768fe4-3b65-4066-a17a-dc307f148549 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.752313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f768fe4-3b65-4066-a17a-dc307f148549 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:25.760839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df0a98-331e-4c42-916c-d9aace3b64bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:25.761808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df0a98-331e-4c42-916c-d9aace3b64bb admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.761808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df0a98-331e-4c42-916c-d9aace3b64bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.762046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df0a98-331e-4c42-916c-d9aace3b64bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.762911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df0a98-331e-4c42-916c-d9aace3b64bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:25.764668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df0a98-331e-4c42-916c-d9aace3b64bb admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:25.778737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1012/2024] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:25.780589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec863bf-e2b2-4518-a1b6-c677e147892c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.791815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec863bf-e2b2-4518-a1b6-c677e147892c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:25.797523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beac69c-afb6-494a-887d-2705cbc6f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:25.798577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac69c-afb6-494a-887d-2705cbc6f03f admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.798972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac69c-afb6-494a-887d-2705cbc6f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.799250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac69c-afb6-494a-887d-2705cbc6f03f admin admin] PATH_INFO: `/v3/projects/0e8f580b3c3f4a73ad065ed08f835ba1/users/0bd628f0e9ee4a81b8850e6a2ff2e62b/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.814833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beac69c-afb6-494a-887d-2705cbc6f03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8f580b3c3f4a73ad065ed08f835ba1, user_id=0bd628f0e9ee4a81b8850e6a2ff2e62b, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:25.817548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beac69c-afb6-494a-887d-2705cbc6f03f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:25.831471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1013/2025] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:25 2022] PUT /identity/v3/projects/0e8f580b3c3f4a73ad065ed08f835ba1/users/0bd628f0e9ee4a81b8850e6a2ff2e62b/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:25.842058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b4172-4653-41d8-a57a-01b855fe312c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.842456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b4172-4653-41d8-a57a-01b855fe312c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.842829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b4172-4653-41d8-a57a-01b855fe312c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.873789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a73b4172-4653-41d8-a57a-01b855fe312c None None] MFA Rules not processed for user `0bd628f0e9ee4a81b8850e6a2ff2e62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:25.875525 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a73b4172-4653-41d8-a57a-01b855fe312c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:25.894533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beac69c-afb6-494a-887d-2705cbc6f03f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.896283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7beac69c-afb6-494a-887d-2705cbc6f03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:25.953972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1013/2026] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:25.968357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beac69c-afb6-494a-887d-2705cbc6f03f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:25.973779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:25.974721 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:25.975343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:25.975626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] PATH_INFO: `/v3/projects/cb771cbf583a4c8e8fdd7a82141998e5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:25.976986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb771cbf583a4c8e8fdd7a82141998e5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:25.979067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:25.986194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b4172-4653-41d8-a57a-01b855fe312c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:25.987727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a73b4172-4653-41d8-a57a-01b855fe312c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.023545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:26.025395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:26.027693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb771cbf583a4c8e8fdd7a82141998e5', 'request_id': 'req-4916c975-cb46-4ded-b934-21142f7edb64'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:26.037301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb771cbf583a4c8e8fdd7a82141998e5', 'request_id': 'req-4916c975-cb46-4ded-b934-21142f7edb64'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:26.043701 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb771cbf583a4c8e8fdd7a82141998e5', 'request_id': 'req-4916c975-cb46-4ded-b934-21142f7edb64'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:26.051741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b4172-4653-41d8-a57a-01b855fe312c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.055001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] The token cache is being invalidate because project cb771cbf583a4c8e8fdd7a82141998e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:26.055360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:26.056074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4916c975-cb46-4ded-b934-21142f7edb64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:26.057699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1014/2027] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:25 2022] DELETE /identity/v3/projects/cb771cbf583a4c8e8fdd7a82141998e5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:26.062291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314dd8a-5b9c-489b-822d-d54289487e83 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.062634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314dd8a-5b9c-489b-822d-d54289487e83 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.062972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314dd8a-5b9c-489b-822d-d54289487e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.081442 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2314dd8a-5b9c-489b-822d-d54289487e83 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:26.082629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2314dd8a-5b9c-489b-822d-d54289487e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.103523 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1fdce-b76a-4e93-98d9-971582d643d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.104174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1fdce-b76a-4e93-98d9-971582d643d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.104513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1fdce-b76a-4e93-98d9-971582d643d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.104794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1fdce-b76a-4e93-98d9-971582d643d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.106569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4dd1fdce-b76a-4e93-98d9-971582d643d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.142725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1015/2028] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:26.150436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1771-9c78-4f5b-b6c7-87b1f09df521 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.150829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1771-9c78-4f5b-b6c7-87b1f09df521 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.151179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1771-9c78-4f5b-b6c7-87b1f09df521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.169385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b0bc1771-9c78-4f5b-b6c7-87b1f09df521 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:26.170575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b0bc1771-9c78-4f5b-b6c7-87b1f09df521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.170689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1fdce-b76a-4e93-98d9-971582d643d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.172100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1fdce-b76a-4e93-98d9-971582d643d7 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.178482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1016/2029] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:26.181243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1014/2030] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:09:26.182587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc1771-9c78-4f5b-b6c7-87b1f09df521 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:26.191824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc1771-9c78-4f5b-b6c7-87b1f09df521 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.195301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1fdce-b76a-4e93-98d9-971582d643d7 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:26.196675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4dd1fdce-b76a-4e93-98d9-971582d643d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.196787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc07f0-099d-48de-b815-44a8dd4fdd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.197329 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc07f0-099d-48de-b815-44a8dd4fdd2e admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.197613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc07f0-099d-48de-b815-44a8dd4fdd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.197889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc07f0-099d-48de-b815-44a8dd4fdd2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.198619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc07f0-099d-48de-b815-44a8dd4fdd2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:26.198966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc07f0-099d-48de-b815-44a8dd4fdd2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.200558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc07f0-099d-48de-b815-44a8dd4fdd2e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.210422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1fdce-b76a-4e93-98d9-971582d643d7 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.215466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1017/2031] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:09:26.217151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc07f0-099d-48de-b815-44a8dd4fdd2e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:26.217632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.218503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.219404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.219684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] PATH_INFO: `/v3/users/0bd628f0e9ee4a81b8850e6a2ff2e62b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.220973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd628f0e9ee4a81b8850e6a2ff2e62b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.222912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.227521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc07f0-099d-48de-b815-44a8dd4fdd2e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.232063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d1d0-1e34-40bb-90bc-b1621a63f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.232697 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d1d0-1e34-40bb-90bc-b1621a63f5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.233022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d1d0-1e34-40bb-90bc-b1621a63f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.233303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d1d0-1e34-40bb-90bc-b1621a63f5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.233991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d1d0-1e34-40bb-90bc-b1621a63f5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.236203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d1d0-1e34-40bb-90bc-b1621a63f5d7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.271504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1018/2032] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:26 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:26.272868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d1d0-1e34-40bb-90bc-b1621a63f5d7 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:26.280026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd628f0e9ee4a81b8850e6a2ff2e62b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:26.280862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd628f0e9ee4a81b8850e6a2ff2e62b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:26.289154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd628f0e9ee4a81b8850e6a2ff2e62b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:26.289841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd628f0e9ee4a81b8850e6a2ff2e62b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:26.304709 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-62262158-831f-4ae0-9330-0197f7ef53bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd628f0e9ee4a81b8850e6a2ff2e62b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:26.330729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1015/2033] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:26 2022] DELETE /identity/v3/users/0bd628f0e9ee4a81b8850e6a2ff2e62b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:26.336575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6dc3b-42ef-4f88-9947-595dea101b00 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.337065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6dc3b-42ef-4f88-9947-595dea101b00 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.337143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6dc3b-42ef-4f88-9947-595dea101b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.363561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d1d0-1e34-40bb-90bc-b1621a63f5d7 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.365311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-64f6dc3b-42ef-4f88-9947-595dea101b00 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:26.366533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-64f6dc3b-42ef-4f88-9947-595dea101b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.378126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:26.428583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:26.443767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1016/2034] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:26.452245 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72a417-d557-4da3-81d1-78bb1118057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.452871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6dc3b-42ef-4f88-9947-595dea101b00 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:26.453603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72a417-d557-4da3-81d1-78bb1118057e admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.453970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72a417-d557-4da3-81d1-78bb1118057e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.454201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72a417-d557-4da3-81d1-78bb1118057e admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.454930 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72a417-d557-4da3-81d1-78bb1118057e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.455054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-64f6dc3b-42ef-4f88-9947-595dea101b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.457042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72a417-d557-4da3-81d1-78bb1118057e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.477599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1019/2035] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:26 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:26.481730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72a417-d557-4da3-81d1-78bb1118057e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:26.483363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6d72a417-d557-4da3-81d1-78bb1118057e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.495593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72a417-d557-4da3-81d1-78bb1118057e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.500789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09374f87-986f-47a1-a31a-35f9d31847e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.501448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374f87-986f-47a1-a31a-35f9d31847e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.501729 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374f87-986f-47a1-a31a-35f9d31847e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.502003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09374f87-986f-47a1-a31a-35f9d31847e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.502734 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09374f87-986f-47a1-a31a-35f9d31847e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.504308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09374f87-986f-47a1-a31a-35f9d31847e2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.515480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1020/2036] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:09:26.520002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09374f87-986f-47a1-a31a-35f9d31847e2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:26.520489 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6dc3b-42ef-4f88-9947-595dea101b00 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.524514 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dca67-eb1c-4cd6-9788-3b440c12cdb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.525222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dca67-eb1c-4cd6-9788-3b440c12cdb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.525504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dca67-eb1c-4cd6-9788-3b440c12cdb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.525779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dca67-eb1c-4cd6-9788-3b440c12cdb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.531162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09374f87-986f-47a1-a31a-35f9d31847e2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.535474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dca67-eb1c-4cd6-9788-3b440c12cdb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.535839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad21a0-a05c-44ec-a1af-b6502c8b3dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.536491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad21a0-a05c-44ec-a1af-b6502c8b3dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.536778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad21a0-a05c-44ec-a1af-b6502c8b3dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.536920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dca67-eb1c-4cd6-9788-3b440c12cdb2 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.537052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad21a0-a05c-44ec-a1af-b6502c8b3dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.537768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad21a0-a05c-44ec-a1af-b6502c8b3dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.539433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad21a0-a05c-44ec-a1af-b6502c8b3dd6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.546464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1017/2037] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:09:26.551344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1021/2038] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:09:26.555321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dca67-eb1c-4cd6-9788-3b440c12cdb2 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:26.565658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dca67-eb1c-4cd6-9788-3b440c12cdb2 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.570289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc98ce0-86b2-4add-a1a1-82e9f65813c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.571211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc98ce0-86b2-4add-a1a1-82e9f65813c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.571522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc98ce0-86b2-4add-a1a1-82e9f65813c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.571800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc98ce0-86b2-4add-a1a1-82e9f65813c2 admin admin] PATH_INFO: `/v3/projects/9272d702579f426d805447236e77e208/users/3dac15058f404f01a9a5fd5936efd327/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.588010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc98ce0-86b2-4add-a1a1-82e9f65813c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9272d702579f426d805447236e77e208, user_id=3dac15058f404f01a9a5fd5936efd327, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.590929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc98ce0-86b2-4add-a1a1-82e9f65813c2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.606569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1018/2039] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:26 2022] PUT /identity/v3/projects/9272d702579f426d805447236e77e208/users/3dac15058f404f01a9a5fd5936efd327/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:26.617642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960bb4-ae1b-49c4-aaca-3aed57fcc02e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.618137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960bb4-ae1b-49c4-aaca-3aed57fcc02e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.618312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960bb4-ae1b-49c4-aaca-3aed57fcc02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.650261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-be960bb4-ae1b-49c4-aaca-3aed57fcc02e None None] MFA Rules not processed for user `3dac15058f404f01a9a5fd5936efd327`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:26.651618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-be960bb4-ae1b-49c4-aaca-3aed57fcc02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.718634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1022/2040] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:26.735331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc98ce0-86b2-4add-a1a1-82e9f65813c2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:26.737397 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-afc98ce0-86b2-4add-a1a1-82e9f65813c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.799353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc98ce0-86b2-4add-a1a1-82e9f65813c2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.803362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb3078-727f-4c4a-92e2-f163b85e8d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.804031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3078-727f-4c4a-92e2-f163b85e8d99 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.804361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3078-727f-4c4a-92e2-f163b85e8d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.804639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3078-727f-4c4a-92e2-f163b85e8d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.814012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb3078-727f-4c4a-92e2-f163b85e8d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.815507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb3078-727f-4c4a-92e2-f163b85e8d99 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.824754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1019/2041] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:26.854475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be960bb4-ae1b-49c4-aaca-3aed57fcc02e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:26.855956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-be960bb4-ae1b-49c4-aaca-3aed57fcc02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:26.935625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be960bb4-ae1b-49c4-aaca-3aed57fcc02e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:26.940870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:26.941765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:26.942052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:26.942332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] PATH_INFO: `/v3/projects/0e8f580b3c3f4a73ad065ed08f835ba1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:26.943853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8f580b3c3f4a73ad065ed08f835ba1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:26.945780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:26.987916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:26.997422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8f580b3c3f4a73ad065ed08f835ba1', 'request_id': 'req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:27.004647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8f580b3c3f4a73ad065ed08f835ba1', 'request_id': 'req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:27.011247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8f580b3c3f4a73ad065ed08f835ba1', 'request_id': 'req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:27.022362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] The token cache is being invalidate because project 0e8f580b3c3f4a73ad065ed08f835ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:27.022654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:27.023314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e9cdc08d-dbbc-4a75-ad52-a6c303cc569d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:27.024996 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1023/2042] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:26 2022] DELETE /identity/v3/projects/0e8f580b3c3f4a73ad065ed08f835ba1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:27.030000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb7ef-ec7a-4342-b57a-538f3c5e0427 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.030294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb7ef-ec7a-4342-b57a-538f3c5e0427 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.030574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb7ef-ec7a-4342-b57a-538f3c5e0427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.049733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-869bb7ef-ec7a-4342-b57a-538f3c5e0427 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:27.050964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-869bb7ef-ec7a-4342-b57a-538f3c5e0427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:27.087596 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:27.122784 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1020/2043] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:27.130847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1567640-de93-4039-baf5-694a5ef309f8 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.131140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1567640-de93-4039-baf5-694a5ef309f8 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.131423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1567640-de93-4039-baf5-694a5ef309f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.150684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f1567640-de93-4039-baf5-694a5ef309f8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:27.151940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f1567640-de93-4039-baf5-694a5ef309f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:27.163088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1024/2044] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:27.169462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bb7ef-ec7a-4342-b57a-538f3c5e0427 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.180823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bb7ef-ec7a-4342-b57a-538f3c5e0427 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.185847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284307-a078-482d-a874-6f438ac1e697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.186503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284307-a078-482d-a874-6f438ac1e697 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.186824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284307-a078-482d-a874-6f438ac1e697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.187098 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284307-a078-482d-a874-6f438ac1e697 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.188789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7284307-a078-482d-a874-6f438ac1e697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:27.189103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7284307-a078-482d-a874-6f438ac1e697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.190718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7284307-a078-482d-a874-6f438ac1e697 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.202228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1021/2045] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:09:27.208874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1567640-de93-4039-baf5-694a5ef309f8 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.218176 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1567640-de93-4039-baf5-694a5ef309f8 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.222987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa231d3-7ee2-42ed-bdaf-b78701958ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.223637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa231d3-7ee2-42ed-bdaf-b78701958ffd admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.223920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa231d3-7ee2-42ed-bdaf-b78701958ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.224197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa231d3-7ee2-42ed-bdaf-b78701958ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.224898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa231d3-7ee2-42ed-bdaf-b78701958ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.226856 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa231d3-7ee2-42ed-bdaf-b78701958ffd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.252894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1025/2046] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:27 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:27.256942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284307-a078-482d-a874-6f438ac1e697 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.267999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284307-a078-482d-a874-6f438ac1e697 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.324550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623fef8-bbbb-4d04-aed8-6c29d5b87115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.325216 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623fef8-bbbb-4d04-aed8-6c29d5b87115 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.325500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623fef8-bbbb-4d04-aed8-6c29d5b87115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.325778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623fef8-bbbb-4d04-aed8-6c29d5b87115 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.326468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623fef8-bbbb-4d04-aed8-6c29d5b87115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.328423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623fef8-bbbb-4d04-aed8-6c29d5b87115 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.348394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1022/2047] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:27 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:27.353788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa231d3-7ee2-42ed-bdaf-b78701958ffd admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.365836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa231d3-7ee2-42ed-bdaf-b78701958ffd admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.370671 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cacf71-4fa5-480d-8e9f-07d5586dcc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.371372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cacf71-4fa5-480d-8e9f-07d5586dcc1b admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.371656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cacf71-4fa5-480d-8e9f-07d5586dcc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.371935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cacf71-4fa5-480d-8e9f-07d5586dcc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.372652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cacf71-4fa5-480d-8e9f-07d5586dcc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.374234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cacf71-4fa5-480d-8e9f-07d5586dcc1b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.386258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1026/2048] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:27.390128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623fef8-bbbb-4d04-aed8-6c29d5b87115 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.401048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623fef8-bbbb-4d04-aed8-6c29d5b87115 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.405812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad838ca-b704-454a-a16d-3edcb8f16591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.406723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad838ca-b704-454a-a16d-3edcb8f16591 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.407029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad838ca-b704-454a-a16d-3edcb8f16591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.407313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad838ca-b704-454a-a16d-3edcb8f16591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.408064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad838ca-b704-454a-a16d-3edcb8f16591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.409660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad838ca-b704-454a-a16d-3edcb8f16591 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.423049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1023/2049] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:27.423935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cacf71-4fa5-480d-8e9f-07d5586dcc1b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.433988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cacf71-4fa5-480d-8e9f-07d5586dcc1b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.439191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491d4f0-d782-42ca-8ba7-f1904123ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.440100 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491d4f0-d782-42ca-8ba7-f1904123ec9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.440380 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491d4f0-d782-42ca-8ba7-f1904123ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.440655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491d4f0-d782-42ca-8ba7-f1904123ec9d admin admin] PATH_INFO: `/v3/projects/c56437b5e03247a2b53d34c4c45a4777/users/e62422cec579400dbf17a637dbd36d08/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.455882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491d4f0-d782-42ca-8ba7-f1904123ec9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56437b5e03247a2b53d34c4c45a4777, user_id=e62422cec579400dbf17a637dbd36d08, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.458836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491d4f0-d782-42ca-8ba7-f1904123ec9d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.473070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1027/2050] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:27 2022] PUT /identity/v3/projects/c56437b5e03247a2b53d34c4c45a4777/users/e62422cec579400dbf17a637dbd36d08/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:27.483070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a607a-2a3a-4867-85b5-2da690c94fc3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.483367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a607a-2a3a-4867-85b5-2da690c94fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.483650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a607a-2a3a-4867-85b5-2da690c94fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.511736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-968a607a-2a3a-4867-85b5-2da690c94fc3 None None] MFA Rules not processed for user `e62422cec579400dbf17a637dbd36d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:27.512895 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-968a607a-2a3a-4867-85b5-2da690c94fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:27.589368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1024/2051] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:27.593823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491d4f0-d782-42ca-8ba7-f1904123ec9d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.662510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491d4f0-d782-42ca-8ba7-f1904123ec9d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.667210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30a310-8d49-41f4-8d9e-d18ec1065eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.667862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30a310-8d49-41f4-8d9e-d18ec1065eae admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.668149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30a310-8d49-41f4-8d9e-d18ec1065eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.668428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30a310-8d49-41f4-8d9e-d18ec1065eae admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.669160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30a310-8d49-41f4-8d9e-d18ec1065eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.671091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30a310-8d49-41f4-8d9e-d18ec1065eae admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.697609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1028/2052] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:27 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:27.701569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a607a-2a3a-4867-85b5-2da690c94fc3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.712637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a607a-2a3a-4867-85b5-2da690c94fc3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.743311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:27.771052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fa454-5859-4b11-a05c-8e085fa8bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.771697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fa454-5859-4b11-a05c-8e085fa8bf6c admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.772030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fa454-5859-4b11-a05c-8e085fa8bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.772304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fa454-5859-4b11-a05c-8e085fa8bf6c admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.772983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fa454-5859-4b11-a05c-8e085fa8bf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.774926 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fa454-5859-4b11-a05c-8e085fa8bf6c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.794520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1025/2053] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:27 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:27.799051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30a310-8d49-41f4-8d9e-d18ec1065eae admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.809137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30a310-8d49-41f4-8d9e-d18ec1065eae admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.814477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206e11b-f285-4cf9-8d48-3352da144505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.815158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e11b-f285-4cf9-8d48-3352da144505 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.815437 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e11b-f285-4cf9-8d48-3352da144505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.815708 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e11b-f285-4cf9-8d48-3352da144505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.816418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206e11b-f285-4cf9-8d48-3352da144505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.817988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206e11b-f285-4cf9-8d48-3352da144505 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.829406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1029/2054] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:27.833498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fa454-5859-4b11-a05c-8e085fa8bf6c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.843384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fa454-5859-4b11-a05c-8e085fa8bf6c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.848580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8f719-5a14-4bd6-8cf1-ca62030d1508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.849453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8f719-5a14-4bd6-8cf1-ca62030d1508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.849734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8f719-5a14-4bd6-8cf1-ca62030d1508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.850011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8f719-5a14-4bd6-8cf1-ca62030d1508 admin admin] PATH_INFO: `/v3/projects/efe7e80060f94543bc9c2cfed1d218e1/users/9c3e0cec27054ab69b16f529c2b6b803/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.864951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8f719-5a14-4bd6-8cf1-ca62030d1508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe7e80060f94543bc9c2cfed1d218e1, user_id=9c3e0cec27054ab69b16f529c2b6b803, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.867710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8f719-5a14-4bd6-8cf1-ca62030d1508 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.880401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1026/2055] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:27 2022] PUT /identity/v3/projects/efe7e80060f94543bc9c2cfed1d218e1/users/9c3e0cec27054ab69b16f529c2b6b803/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:27.884930 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206e11b-f285-4cf9-8d48-3352da144505 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.898759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206e11b-f285-4cf9-8d48-3352da144505 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.936131 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:27.960969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7e34-fc16-45a8-991d-b15489043e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.961631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7e34-fc16-45a8-991d-b15489043e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.961916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7e34-fc16-45a8-991d-b15489043e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.962198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7e34-fc16-45a8-991d-b15489043e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.962945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d7e34-fc16-45a8-991d-b15489043e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:27.964537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d7e34-fc16-45a8-991d-b15489043e3c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:27.974995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1030/2056] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:09:27.979390 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8f719-5a14-4bd6-8cf1-ca62030d1508 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:27.989996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8f719-5a14-4bd6-8cf1-ca62030d1508 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:27.994648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccad20-e581-427e-b401-e02417b9d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:27.995570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccad20-e581-427e-b401-e02417b9d89a admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:27.995854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccad20-e581-427e-b401-e02417b9d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:27.996124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccad20-e581-427e-b401-e02417b9d89a admin admin] PATH_INFO: `/v3/projects/efe7e80060f94543bc9c2cfed1d218e1/users/9c3e0cec27054ab69b16f529c2b6b803/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:27.998097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccad20-e581-427e-b401-e02417b9d89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe7e80060f94543bc9c2cfed1d218e1, user_id=9c3e0cec27054ab69b16f529c2b6b803, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:28.000779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccad20-e581-427e-b401-e02417b9d89a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:28.011498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1027/2057] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:27 2022] PUT /identity/v3/projects/efe7e80060f94543bc9c2cfed1d218e1/users/9c3e0cec27054ab69b16f529c2b6b803/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:28.021538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da760dd-660a-48fb-842c-c2db19d167fc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:28.021761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da760dd-660a-48fb-842c-c2db19d167fc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:28.022041 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da760dd-660a-48fb-842c-c2db19d167fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:28.048797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3da760dd-660a-48fb-842c-c2db19d167fc None None] MFA Rules not processed for user `9c3e0cec27054ab69b16f529c2b6b803`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:28.049988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3da760dd-660a-48fb-842c-c2db19d167fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:28.117381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1031/2058] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:28.128989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccad20-e581-427e-b401-e02417b9d89a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:28.130851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a9ccad20-e581-427e-b401-e02417b9d89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:28.189798 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccad20-e581-427e-b401-e02417b9d89a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:28.193524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdfd23-13ef-4e32-9043-4135bebd79e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:28.194160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdfd23-13ef-4e32-9043-4135bebd79e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:28.194439 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdfd23-13ef-4e32-9043-4135bebd79e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:28.194795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdfd23-13ef-4e32-9043-4135bebd79e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:28.257732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdfd23-13ef-4e32-9043-4135bebd79e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:28.259201 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdfd23-13ef-4e32-9043-4135bebd79e6 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:28.268239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1028/2059] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:32.648453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da760dd-660a-48fb-842c-c2db19d167fc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:32.649860 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3da760dd-660a-48fb-842c-c2db19d167fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:32.714018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da760dd-660a-48fb-842c-c2db19d167fc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:32.719136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:32.720067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:32.720347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:32.720624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] PATH_INFO: `/v3/users/a1ab73385eb84d3eb59127ab1a317305` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:32.721813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ab73385eb84d3eb59127ab1a317305)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:32.723767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:32.770402 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ab73385eb84d3eb59127ab1a317305'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:32.777428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ab73385eb84d3eb59127ab1a317305'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:32.778030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ab73385eb84d3eb59127ab1a317305'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:32.778676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ab73385eb84d3eb59127ab1a317305'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:32.783980 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:32.792112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ab73385eb84d3eb59127ab1a317305'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:32.804438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1032/2060] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:32 2022] DELETE /identity/v3/users/a1ab73385eb84d3eb59127ab1a317305 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:32.808898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845190f-7d93-4724-bb69-c2c5a1bdaa51 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:32.809399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845190f-7d93-4724-bb69-c2c5a1bdaa51 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:32.809500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845190f-7d93-4724-bb69-c2c5a1bdaa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:32.826472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8845190f-7d93-4724-bb69-c2c5a1bdaa51 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:32.828264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8845190f-7d93-4724-bb69-c2c5a1bdaa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:32.869649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:32.899476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1029/2061] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:32.912563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:32.913973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:32.977341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a6b2d-4e9d-456e-93e9-9587a3315efe admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:32.981871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b146-3ff6-478e-91a6-ac0f9a6f7658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:32.983487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b146-3ff6-478e-91a6-ac0f9a6f7658 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:32.983487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b146-3ff6-478e-91a6-ac0f9a6f7658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:32.983487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b146-3ff6-478e-91a6-ac0f9a6f7658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:32.995439 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86b146-3ff6-478e-91a6-ac0f9a6f7658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:32.997154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86b146-3ff6-478e-91a6-ac0f9a6f7658 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:33.008254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1033/2062] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:33.295021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845190f-7d93-4724-bb69-c2c5a1bdaa51 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:33.297361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8845190f-7d93-4724-bb69-c2c5a1bdaa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:33.330600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845190f-7d93-4724-bb69-c2c5a1bdaa51 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:33.336796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:33.337787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:33.338150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:33.338678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] PATH_INFO: `/v3/projects/b025abd8496442408a4fde1926bf33f6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:33.340113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b025abd8496442408a4fde1926bf33f6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:33.342342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:33.403362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b025abd8496442408a4fde1926bf33f6', 'request_id': 'req-0462d400-073d-41ce-af38-2a2799c69af7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:33.411898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b025abd8496442408a4fde1926bf33f6', 'request_id': 'req-0462d400-073d-41ce-af38-2a2799c69af7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:33.418084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b025abd8496442408a4fde1926bf33f6', 'request_id': 'req-0462d400-073d-41ce-af38-2a2799c69af7'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:33.431447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] The token cache is being invalidate because project b025abd8496442408a4fde1926bf33f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:33.431816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:33.432533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:33.436344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1030/2063] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:33 2022] DELETE /identity/v3/projects/b025abd8496442408a4fde1926bf33f6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:33.441055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b146-3ff6-478e-91a6-ac0f9a6f7658 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:33.451757 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b146-3ff6-478e-91a6-ac0f9a6f7658 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:33.521046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:33.521921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:33.522202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:33.522477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] PATH_INFO: `/v3/users/d146679abc8d4cfba4a41b8f84ea9f27` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:33.523903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d146679abc8d4cfba4a41b8f84ea9f27)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:33.526139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:33.573069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd146679abc8d4cfba4a41b8f84ea9f27'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:33.580106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd146679abc8d4cfba4a41b8f84ea9f27'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:33.580788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd146679abc8d4cfba4a41b8f84ea9f27'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:33.581406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd146679abc8d4cfba4a41b8f84ea9f27'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:33.593058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd146679abc8d4cfba4a41b8f84ea9f27'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:33.601990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:33.606921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1034/2064] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:33 2022] DELETE /identity/v3/users/d146679abc8d4cfba4a41b8f84ea9f27 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:33.877226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:33.878658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:33.894470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462d400-073d-41ce-af38-2a2799c69af7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:33.951680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:33.952537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:33.952896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:33.953163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] PATH_INFO: `/v3/projects/d809e494df194dc6ba666e64cae8d265` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:33.954329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d809e494df194dc6ba666e64cae8d265)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:33.956374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:34.002107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd809e494df194dc6ba666e64cae8d265', 'request_id': 'req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:34.010050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd809e494df194dc6ba666e64cae8d265', 'request_id': 'req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:34.016017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd809e494df194dc6ba666e64cae8d265', 'request_id': 'req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:34.017094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:34.029073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:34.030450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:34.031339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] The token cache is being invalidate because project d809e494df194dc6ba666e64cae8d265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:34.031824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:34.032581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b7bd1a72-3a5f-4c26-b853-ce3e89d4bd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:34.034106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1031/2065] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:33 2022] DELETE /identity/v3/projects/d809e494df194dc6ba666e64cae8d265 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:34.038613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fa9c3-a6cd-4380-b16a-b2e0bce1de03 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.038976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fa9c3-a6cd-4380-b16a-b2e0bce1de03 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.039260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fa9c3-a6cd-4380-b16a-b2e0bce1de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.043982 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd79980-9542-43f5-81f8-2405ff50427b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:34.057825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e05fa9c3-a6cd-4380-b16a-b2e0bce1de03 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:34.059050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e05fa9c3-a6cd-4380-b16a-b2e0bce1de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:34.104538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:34.105405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.105685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.105985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] PATH_INFO: `/v3/users/e62422cec579400dbf17a637dbd36d08` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.107225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e62422cec579400dbf17a637dbd36d08)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:34.109254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:34.121508 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1032/2066] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:34.129992 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cb253-6330-448a-b758-38595c8788f4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.130260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cb253-6330-448a-b758-38595c8788f4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.130534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cb253-6330-448a-b758-38595c8788f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.150567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c54cb253-6330-448a-b758-38595c8788f4 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:34.151830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c54cb253-6330-448a-b758-38595c8788f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:34.160994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1033/2067] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:34.165406 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cb253-6330-448a-b758-38595c8788f4 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:34.175215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e62422cec579400dbf17a637dbd36d08'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:34.176185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cb253-6330-448a-b758-38595c8788f4 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:34.184194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e62422cec579400dbf17a637dbd36d08'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:34.184884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e62422cec579400dbf17a637dbd36d08'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:34.185586 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e62422cec579400dbf17a637dbd36d08'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:34.190067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b581ec4-8cf0-4ba7-b38b-d5e63f72ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:34.190946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b581ec4-8cf0-4ba7-b38b-d5e63f72ea73 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.191234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b581ec4-8cf0-4ba7-b38b-d5e63f72ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.191505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b581ec4-8cf0-4ba7-b38b-d5e63f72ea73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.192241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b581ec4-8cf0-4ba7-b38b-d5e63f72ea73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:34.192670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b581ec4-8cf0-4ba7-b38b-d5e63f72ea73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:34.194303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b581ec4-8cf0-4ba7-b38b-d5e63f72ea73 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:34.202933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2f6b3f8c-6e98-45a9-8df5-a8010948c6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e62422cec579400dbf17a637dbd36d08'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:34.208921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1034/2068] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:09:34.213335 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b581ec4-8cf0-4ba7-b38b-d5e63f72ea73 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:34.215270 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4b581ec4-8cf0-4ba7-b38b-d5e63f72ea73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:34.225837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1035/2069] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:34 2022] DELETE /identity/v3/users/e62422cec579400dbf17a637dbd36d08 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:34.230053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03ac8-7fc1-46b7-a660-f0a8a6b2d0d7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.230348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03ac8-7fc1-46b7-a660-f0a8a6b2d0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.230634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03ac8-7fc1-46b7-a660-f0a8a6b2d0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.236065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b581ec4-8cf0-4ba7-b38b-d5e63f72ea73 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:34.249834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5fa03ac8-7fc1-46b7-a660-f0a8a6b2d0d7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:34.251076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5fa03ac8-7fc1-46b7-a660-f0a8a6b2d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:34.297869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16f914-1b0f-4d93-a2ba-cbd79070a724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:34.298859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16f914-1b0f-4d93-a2ba-cbd79070a724 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.299316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16f914-1b0f-4d93-a2ba-cbd79070a724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.299739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16f914-1b0f-4d93-a2ba-cbd79070a724 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.301448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16f914-1b0f-4d93-a2ba-cbd79070a724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:34.303723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16f914-1b0f-4d93-a2ba-cbd79070a724 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:34.330004 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1036/2070] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:34.342503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa03ac8-7fc1-46b7-a660-f0a8a6b2d0d7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:34.344498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5fa03ac8-7fc1-46b7-a660-f0a8a6b2d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:34.351478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1035/2071] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:34 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:34.352974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16f914-1b0f-4d93-a2ba-cbd79070a724 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:34.376876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:34.450187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa03ac8-7fc1-46b7-a660-f0a8a6b2d0d7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:34.473133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16f914-1b0f-4d93-a2ba-cbd79070a724 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:34.486046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e42dd-8b20-4ab1-bbda-1e85d43893d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:34.486786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e42dd-8b20-4ab1-bbda-1e85d43893d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.487030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e42dd-8b20-4ab1-bbda-1e85d43893d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.487303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e42dd-8b20-4ab1-bbda-1e85d43893d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.487995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e42dd-8b20-4ab1-bbda-1e85d43893d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:34.489938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e42dd-8b20-4ab1-bbda-1e85d43893d4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:34.504898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:34.541693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c12b0-e4a8-472c-b1d5-bc4d1d328ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:34.542629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c12b0-e4a8-472c-b1d5-bc4d1d328ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.543052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1036/2072] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:34 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:34.543277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c12b0-e4a8-472c-b1d5-bc4d1d328ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.543557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c12b0-e4a8-472c-b1d5-bc4d1d328ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.546994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e42dd-8b20-4ab1-bbda-1e85d43893d4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:34.554519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c12b0-e4a8-472c-b1d5-bc4d1d328ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:34.556087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c12b0-e4a8-472c-b1d5-bc4d1d328ef0 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:34.558761 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e42dd-8b20-4ab1-bbda-1e85d43893d4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:34.564078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28144c00-de9b-42ef-8e82-4d10e39d8a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:34.564540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28144c00-de9b-42ef-8e82-4d10e39d8a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.564824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28144c00-de9b-42ef-8e82-4d10e39d8a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.565373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28144c00-de9b-42ef-8e82-4d10e39d8a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.565828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28144c00-de9b-42ef-8e82-4d10e39d8a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:34.567477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28144c00-de9b-42ef-8e82-4d10e39d8a15 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:34.568515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1037/2073] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:09:34.602025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1037/2074] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:34.606076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c12b0-e4a8-472c-b1d5-bc4d1d328ef0 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:34.621116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c12b0-e4a8-472c-b1d5-bc4d1d328ef0 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:34.629494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bf5b5-0a26-431a-a586-acf700f64268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:34.630084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bf5b5-0a26-431a-a586-acf700f64268 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.630364 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bf5b5-0a26-431a-a586-acf700f64268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.630637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bf5b5-0a26-431a-a586-acf700f64268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.631393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bf5b5-0a26-431a-a586-acf700f64268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:34.634271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bf5b5-0a26-431a-a586-acf700f64268 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:34.656321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1038/2075] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:34.656906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28144c00-de9b-42ef-8e82-4d10e39d8a15 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:34.667861 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28144c00-de9b-42ef-8e82-4d10e39d8a15 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:34.674142 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4a455-e18b-409f-af6d-caf6f6f1003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:34.676315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4a455-e18b-409f-af6d-caf6f6f1003d admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.676315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4a455-e18b-409f-af6d-caf6f6f1003d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.676315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4a455-e18b-409f-af6d-caf6f6f1003d admin admin] PATH_INFO: `/v3/projects/e799f3082f7a4f17b09be46bfbfeed67/users/7c00fc4e1c874cc2939d4e4f91e1a6e5/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.700839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4a455-e18b-409f-af6d-caf6f6f1003d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e799f3082f7a4f17b09be46bfbfeed67, user_id=7c00fc4e1c874cc2939d4e4f91e1a6e5, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:34.703774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4a455-e18b-409f-af6d-caf6f6f1003d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:34.726271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1038/2076] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:34 2022] PUT /identity/v3/projects/e799f3082f7a4f17b09be46bfbfeed67/users/7c00fc4e1c874cc2939d4e4f91e1a6e5/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:34.738032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ef26-8b23-4e8d-b77e-1b3f280dbecd None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:34.738328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ef26-8b23-4e8d-b77e-1b3f280dbecd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:34.738604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ef26-8b23-4e8d-b77e-1b3f280dbecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:34.800623 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ed35ef26-8b23-4e8d-b77e-1b3f280dbecd None None] MFA Rules not processed for user `7c00fc4e1c874cc2939d4e4f91e1a6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:34.802994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ed35ef26-8b23-4e8d-b77e-1b3f280dbecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:34.901589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1039/2077] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:34.906429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35ef26-8b23-4e8d-b77e-1b3f280dbecd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:34.908147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4a455-e18b-409f-af6d-caf6f6f1003d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:34.911506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-20f4a455-e18b-409f-af6d-caf6f6f1003d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:35.004195 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4a455-e18b-409f-af6d-caf6f6f1003d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:35.005094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:35.010649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35ef26-8b23-4e8d-b77e-1b3f280dbecd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:35.018029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0f5aa-163e-47dd-88b5-1014b54f0824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:35.019001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0f5aa-163e-47dd-88b5-1014b54f0824 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.019351 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0f5aa-163e-47dd-88b5-1014b54f0824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.019714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0f5aa-163e-47dd-88b5-1014b54f0824 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.020519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0f5aa-163e-47dd-88b5-1014b54f0824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:35.022448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0f5aa-163e-47dd-88b5-1014b54f0824 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:35.023137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:35.024195 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.024503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.024784 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] PATH_INFO: `/v3/projects/c56437b5e03247a2b53d34c4c45a4777` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.026402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56437b5e03247a2b53d34c4c45a4777)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:35.031331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:35.067582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1040/2078] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:34 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:35.069132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0f5aa-163e-47dd-88b5-1014b54f0824 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:35.100935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56437b5e03247a2b53d34c4c45a4777', 'request_id': 'req-f9ce4007-4ecf-43c5-8b84-87526e354dff'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:35.119333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56437b5e03247a2b53d34c4c45a4777', 'request_id': 'req-f9ce4007-4ecf-43c5-8b84-87526e354dff'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:35.127252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56437b5e03247a2b53d34c4c45a4777', 'request_id': 'req-f9ce4007-4ecf-43c5-8b84-87526e354dff'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:35.141241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] The token cache is being invalidate because project c56437b5e03247a2b53d34c4c45a4777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:35.141605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:35.142403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:35.144386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1039/2079] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:34 2022] DELETE /identity/v3/projects/c56437b5e03247a2b53d34c4c45a4777 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:35.147660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0f5aa-163e-47dd-88b5-1014b54f0824 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:35.148291 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:35.150470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:35.207681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:35.220508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dbe9f-7c84-4ab0-8cd4-19f0bb643ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:35.221591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dbe9f-7c84-4ab0-8cd4-19f0bb643ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.222169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dbe9f-7c84-4ab0-8cd4-19f0bb643ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.222604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dbe9f-7c84-4ab0-8cd4-19f0bb643ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.223494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dbe9f-7c84-4ab0-8cd4-19f0bb643ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:35.225459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dbe9f-7c84-4ab0-8cd4-19f0bb643ef4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:35.231326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce4007-4ecf-43c5-8b84-87526e354dff admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:35.237876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:35.239330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.239330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.239669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] PATH_INFO: `/v3/users/9c3e0cec27054ab69b16f529c2b6b803` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.240887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3e0cec27054ab69b16f529c2b6b803)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:35.242948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:35.255489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1041/2080] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:35 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:35.260367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dbe9f-7c84-4ab0-8cd4-19f0bb643ef4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:35.261495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ac9dbe9f-7c84-4ab0-8cd4-19f0bb643ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:35.275513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dbe9f-7c84-4ab0-8cd4-19f0bb643ef4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:35.281359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc69860-0b80-486c-9b12-d510619e6ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:35.282073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69860-0b80-486c-9b12-d510619e6ead admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.282355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69860-0b80-486c-9b12-d510619e6ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.282644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69860-0b80-486c-9b12-d510619e6ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.283384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc69860-0b80-486c-9b12-d510619e6ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:35.285020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc69860-0b80-486c-9b12-d510619e6ead admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:35.298225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1042/2081] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:35.302240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc69860-0b80-486c-9b12-d510619e6ead admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:35.312468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc69860-0b80-486c-9b12-d510619e6ead admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:35.312659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3e0cec27054ab69b16f529c2b6b803'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:35.313354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3e0cec27054ab69b16f529c2b6b803'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:35.318141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7815119-3298-49b0-afb3-51ddf82a042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:35.319125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815119-3298-49b0-afb3-51ddf82a042a admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.319473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815119-3298-49b0-afb3-51ddf82a042a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.319815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815119-3298-49b0-afb3-51ddf82a042a admin admin] PATH_INFO: `/v3/projects/ece13074014e41418703c18d4296541b/users/95027d9f4b6e41e0b97151efae9c679a/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.324159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3e0cec27054ab69b16f529c2b6b803'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:35.324922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3e0cec27054ab69b16f529c2b6b803'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:35.336738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7815119-3298-49b0-afb3-51ddf82a042a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece13074014e41418703c18d4296541b, user_id=95027d9f4b6e41e0b97151efae9c679a, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:35.339579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7815119-3298-49b0-afb3-51ddf82a042a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:35.339786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3e0cec27054ab69b16f529c2b6b803'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:35.357035 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1043/2082] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:35 2022] PUT /identity/v3/projects/ece13074014e41418703c18d4296541b/users/95027d9f4b6e41e0b97151efae9c679a/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:35.357729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1040/2083] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:35 2022] DELETE /identity/v3/users/9c3e0cec27054ab69b16f529c2b6b803 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:35.360731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7815119-3298-49b0-afb3-51ddf82a042a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:35.363042 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a7815119-3298-49b0-afb3-51ddf82a042a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:35.424798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:35.449986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7815119-3298-49b0-afb3-51ddf82a042a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:35.544395 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11d3c9-665c-4a10-af23-b118824071f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:35.545085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d3c9-665c-4a10-af23-b118824071f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.545373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d3c9-665c-4a10-af23-b118824071f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.547804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d3c9-665c-4a10-af23-b118824071f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.548672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11d3c9-665c-4a10-af23-b118824071f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:35.550413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11d3c9-665c-4a10-af23-b118824071f9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:35.569821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:35.576358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1044/2084] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:35.593369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145154-3cea-4433-ae94-331ce893c934 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:35.613477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add9be3-4867-49d6-8905-9b98d903839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:35.615713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add9be3-4867-49d6-8905-9b98d903839e admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.618023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add9be3-4867-49d6-8905-9b98d903839e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.619122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add9be3-4867-49d6-8905-9b98d903839e admin admin] PATH_INFO: `/v3/projects/ece13074014e41418703c18d4296541b/users/95027d9f4b6e41e0b97151efae9c679a/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.626442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add9be3-4867-49d6-8905-9b98d903839e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece13074014e41418703c18d4296541b, user_id=95027d9f4b6e41e0b97151efae9c679a, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:35.639167 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add9be3-4867-49d6-8905-9b98d903839e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:35.666522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1041/2085] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:35 2022] PUT /identity/v3/projects/ece13074014e41418703c18d4296541b/users/95027d9f4b6e41e0b97151efae9c679a/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:35.677219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd573fb-c36d-4241-93e0-430ec2caad37 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.677510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd573fb-c36d-4241-93e0-430ec2caad37 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.677787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd573fb-c36d-4241-93e0-430ec2caad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.711194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-dfd573fb-c36d-4241-93e0-430ec2caad37 None None] MFA Rules not processed for user `95027d9f4b6e41e0b97151efae9c679a`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:35.712556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dfd573fb-c36d-4241-93e0-430ec2caad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:35.793876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add9be3-4867-49d6-8905-9b98d903839e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:35.795878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2add9be3-4867-49d6-8905-9b98d903839e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:35.809129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1045/2086] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:35.826747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd573fb-c36d-4241-93e0-430ec2caad37 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:35.830018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dfd573fb-c36d-4241-93e0-430ec2caad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:35.896795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add9be3-4867-49d6-8905-9b98d903839e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:35.909595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:35.910238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.911855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.912157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] PATH_INFO: `/v3/projects/efe7e80060f94543bc9c2cfed1d218e1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.915791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe7e80060f94543bc9c2cfed1d218e1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:35.919589 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:35.923249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd573fb-c36d-4241-93e0-430ec2caad37 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:35.932133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a971b36-b3e1-4f78-8b88-ea6edcace5c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:35.933620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971b36-b3e1-4f78-8b88-ea6edcace5c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:35.933985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971b36-b3e1-4f78-8b88-ea6edcace5c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:35.934605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971b36-b3e1-4f78-8b88-ea6edcace5c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:35.947174 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a971b36-b3e1-4f78-8b88-ea6edcace5c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:35.956828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a971b36-b3e1-4f78-8b88-ea6edcace5c8 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:35.970154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1046/2087] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:35.971648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a971b36-b3e1-4f78-8b88-ea6edcace5c8 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:35.983083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0a971b36-b3e1-4f78-8b88-ea6edcace5c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:35.990415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe7e80060f94543bc9c2cfed1d218e1', 'request_id': 'req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:36.001947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:36.014060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe7e80060f94543bc9c2cfed1d218e1', 'request_id': 'req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:36.018610 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a971b36-b3e1-4f78-8b88-ea6edcace5c8 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:36.026139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe7e80060f94543bc9c2cfed1d218e1', 'request_id': 'req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:36.038672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:36.058519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] The token cache is being invalidate because project efe7e80060f94543bc9c2cfed1d218e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:36.058846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:36.067210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-af9ed5c2-6ddc-4fc6-b1e7-68cb17c52913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:36.075240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1042/2088] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:35 2022] DELETE /identity/v3/projects/efe7e80060f94543bc9c2cfed1d218e1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:36.078286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c23d0-44d2-42d3-8d7e-2a2272f9c64b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.078588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c23d0-44d2-42d3-8d7e-2a2272f9c64b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.078900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c23d0-44d2-42d3-8d7e-2a2272f9c64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.115152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e73c23d0-44d2-42d3-8d7e-2a2272f9c64b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:36.116483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e73c23d0-44d2-42d3-8d7e-2a2272f9c64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:36.130136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:36.131183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.131467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.131748 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] PATH_INFO: `/v3/users/f7211bcffb8246e8b56b57742b985134` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.133224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7211bcffb8246e8b56b57742b985134)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:36.135203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:36.179016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1043/2089] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:36.179740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c23d0-44d2-42d3-8d7e-2a2272f9c64b None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:36.180998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e73c23d0-44d2-42d3-8d7e-2a2272f9c64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:36.190726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7211bcffb8246e8b56b57742b985134'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:36.197803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7211bcffb8246e8b56b57742b985134'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:36.198576 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7211bcffb8246e8b56b57742b985134'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:36.199231 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7211bcffb8246e8b56b57742b985134'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:36.211189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-335af0d9-062b-417e-b768-daeba38cb6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7211bcffb8246e8b56b57742b985134'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:36.225272 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1047/2090] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:35 2022] DELETE /identity/v3/users/f7211bcffb8246e8b56b57742b985134 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:36.226619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae564c-859c-4205-b097-9625d20d8034 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.226935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae564c-859c-4205-b097-9625d20d8034 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.227212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae564c-859c-4205-b097-9625d20d8034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.241226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c23d0-44d2-42d3-8d7e-2a2272f9c64b None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:36.244814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b4ae564c-859c-4205-b097-9625d20d8034 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:36.246015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b4ae564c-859c-4205-b097-9625d20d8034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:36.291007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08646eeb-d0de-4df1-80de-7320eb8ba340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:36.291672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08646eeb-d0de-4df1-80de-7320eb8ba340 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.291944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08646eeb-d0de-4df1-80de-7320eb8ba340 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.292219 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08646eeb-d0de-4df1-80de-7320eb8ba340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.294016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-08646eeb-d0de-4df1-80de-7320eb8ba340 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:36.315522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1048/2091] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:36.317159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c204-0826-43f8-9224-8d0b00736078 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.317573 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c204-0826-43f8-9224-8d0b00736078 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.317859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c204-0826-43f8-9224-8d0b00736078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.335980 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6a27c204-0826-43f8-9224-8d0b00736078 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:36.337180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6a27c204-0826-43f8-9224-8d0b00736078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:36.347361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1049/2092] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:36.348597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27c204-0826-43f8-9224-8d0b00736078 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:36.358251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:36.359939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27c204-0826-43f8-9224-8d0b00736078 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:36.364607 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe459593-b126-4a49-99a0-2ea9475afcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:36.365279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe459593-b126-4a49-99a0-2ea9475afcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.365548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe459593-b126-4a49-99a0-2ea9475afcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.365821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe459593-b126-4a49-99a0-2ea9475afcf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.366619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe459593-b126-4a49-99a0-2ea9475afcf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:36.367006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe459593-b126-4a49-99a0-2ea9475afcf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:36.368818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe459593-b126-4a49-99a0-2ea9475afcf8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:36.370499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08646eeb-d0de-4df1-80de-7320eb8ba340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:36.372848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08646eeb-d0de-4df1-80de-7320eb8ba340 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:36.384593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1050/2093] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:09:36.384593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe459593-b126-4a49-99a0-2ea9475afcf8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:36.384831 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1044/2094] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:36.385855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08646eeb-d0de-4df1-80de-7320eb8ba340 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:36.386443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fe459593-b126-4a49-99a0-2ea9475afcf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:36.398320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08646eeb-d0de-4df1-80de-7320eb8ba340 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:36.403473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c185f-ea5a-4b77-8927-0c649d38d5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:36.404218 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c185f-ea5a-4b77-8927-0c649d38d5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.404473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c185f-ea5a-4b77-8927-0c649d38d5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.404807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c185f-ea5a-4b77-8927-0c649d38d5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.406206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c185f-ea5a-4b77-8927-0c649d38d5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:36.408606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c185f-ea5a-4b77-8927-0c649d38d5a3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:36.413582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:36.440588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1045/2095] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:36 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:36.444661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c185f-ea5a-4b77-8927-0c649d38d5a3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:36.462842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe459593-b126-4a49-99a0-2ea9475afcf8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:36.525790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4811d-6a28-48aa-adc9-ee6953308d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:36.526730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4811d-6a28-48aa-adc9-ee6953308d61 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.526829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4811d-6a28-48aa-adc9-ee6953308d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.527630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4811d-6a28-48aa-adc9-ee6953308d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.533125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c185f-ea5a-4b77-8927-0c649d38d5a3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:36.538002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c43cb9-ccb5-43d3-8185-5d6a69e93af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:36.538674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43cb9-ccb5-43d3-8185-5d6a69e93af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.538984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43cb9-ccb5-43d3-8185-5d6a69e93af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.539261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43cb9-ccb5-43d3-8185-5d6a69e93af4 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.539948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c43cb9-ccb5-43d3-8185-5d6a69e93af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:36.540521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4811d-6a28-48aa-adc9-ee6953308d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:36.541981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c43cb9-ccb5-43d3-8185-5d6a69e93af4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:36.542509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4811d-6a28-48aa-adc9-ee6953308d61 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:36.554438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1051/2096] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:36.566796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1046/2097] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:36 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:36.570274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4811d-6a28-48aa-adc9-ee6953308d61 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:36.583246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4811d-6a28-48aa-adc9-ee6953308d61 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:36.591146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f4d08-715d-4afa-9473-097ff0dbd0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:36.591984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f4d08-715d-4afa-9473-097ff0dbd0fd admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.592268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f4d08-715d-4afa-9473-097ff0dbd0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.592722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f4d08-715d-4afa-9473-097ff0dbd0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.594217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f4d08-715d-4afa-9473-097ff0dbd0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:36.596142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f4d08-715d-4afa-9473-097ff0dbd0fd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:36.610103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1052/2098] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:36.611347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c43cb9-ccb5-43d3-8185-5d6a69e93af4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:36.624093 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c43cb9-ccb5-43d3-8185-5d6a69e93af4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:36.629627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858eadfb-6466-4ada-a4a5-b84981c4ef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:36.630302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eadfb-6466-4ada-a4a5-b84981c4ef09 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.630633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eadfb-6466-4ada-a4a5-b84981c4ef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.630965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eadfb-6466-4ada-a4a5-b84981c4ef09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.631750 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858eadfb-6466-4ada-a4a5-b84981c4ef09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:36.633699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858eadfb-6466-4ada-a4a5-b84981c4ef09 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:36.645243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1047/2099] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:36.649309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f4d08-715d-4afa-9473-097ff0dbd0fd admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:36.662661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f4d08-715d-4afa-9473-097ff0dbd0fd admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:36.668778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a1d6b-2d8b-4d04-b0d8-2a3686a2173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:36.669750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a1d6b-2d8b-4d04-b0d8-2a3686a2173b admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.670058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a1d6b-2d8b-4d04-b0d8-2a3686a2173b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.670298 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a1d6b-2d8b-4d04-b0d8-2a3686a2173b admin admin] PATH_INFO: `/v3/projects/8a04e0b3165e4edfba2e2c4d04aa8ed6/users/54c65a1967814a6bbb34f116dadb4180/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.691650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a1d6b-2d8b-4d04-b0d8-2a3686a2173b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a04e0b3165e4edfba2e2c4d04aa8ed6, user_id=54c65a1967814a6bbb34f116dadb4180, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:36.694535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a1d6b-2d8b-4d04-b0d8-2a3686a2173b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:36.711567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1053/2100] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:36 2022] PUT /identity/v3/projects/8a04e0b3165e4edfba2e2c4d04aa8ed6/users/54c65a1967814a6bbb34f116dadb4180/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:36.722886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a99704-5788-4653-a5ff-a9d8d6243e33 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:36.723185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a99704-5788-4653-a5ff-a9d8d6243e33 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:36.723464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a99704-5788-4653-a5ff-a9d8d6243e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:36.789114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-16a99704-5788-4653-a5ff-a9d8d6243e33 None None] MFA Rules not processed for user `54c65a1967814a6bbb34f116dadb4180`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:36.790337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-16a99704-5788-4653-a5ff-a9d8d6243e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:36.908253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1048/2101] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:36.944511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a1d6b-2d8b-4d04-b0d8-2a3686a2173b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:36.946423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7a5a1d6b-2d8b-4d04-b0d8-2a3686a2173b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:36.955946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a99704-5788-4653-a5ff-a9d8d6243e33 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:36.957545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-16a99704-5788-4653-a5ff-a9d8d6243e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:37.013498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:37.042852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a99704-5788-4653-a5ff-a9d8d6243e33 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:37.047502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a07518-aa65-4c3f-b292-ba352ea58c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:37.048409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a07518-aa65-4c3f-b292-ba352ea58c85 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.048678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a07518-aa65-4c3f-b292-ba352ea58c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.049018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a07518-aa65-4c3f-b292-ba352ea58c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.058739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a07518-aa65-4c3f-b292-ba352ea58c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:37.060718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a07518-aa65-4c3f-b292-ba352ea58c85 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:37.071597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a1d6b-2d8b-4d04-b0d8-2a3686a2173b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:37.074681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1049/2102] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:37.076453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:37.077307 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.077641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.077943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] PATH_INFO: `/v3/projects/2684c3e9cd514741894b297794d45bea` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.079554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2684c3e9cd514741894b297794d45bea)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:37.081482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:37.127075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:37.136725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2684c3e9cd514741894b297794d45bea', 'request_id': 'req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:37.146549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2684c3e9cd514741894b297794d45bea', 'request_id': 'req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:37.155148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2684c3e9cd514741894b297794d45bea', 'request_id': 'req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:37.168997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] The token cache is being invalidate because project 2684c3e9cd514741894b297794d45bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:37.169609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:37.175240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c4ec0693-7f46-4f22-bebf-a4c4780a96ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:37.181159 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1054/2103] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:36 2022] DELETE /identity/v3/projects/2684c3e9cd514741894b297794d45bea => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:37.183291 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a8caa-77a4-4c08-9c13-740e307df956 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.183678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a8caa-77a4-4c08-9c13-740e307df956 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.184067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a8caa-77a4-4c08-9c13-740e307df956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.219923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ec1a8caa-77a4-4c08-9c13-740e307df956 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:37.224440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ec1a8caa-77a4-4c08-9c13-740e307df956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:37.360206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1050/2104] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:37.368684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46dca6-6366-4808-a14c-b6c7274acb80 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.369711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46dca6-6366-4808-a14c-b6c7274acb80 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.370341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46dca6-6366-4808-a14c-b6c7274acb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.397495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ad46dca6-6366-4808-a14c-b6c7274acb80 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:37.399334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ad46dca6-6366-4808-a14c-b6c7274acb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:37.414799 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1055/2105] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:37.419141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a8caa-77a4-4c08-9c13-740e307df956 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:37.429840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a8caa-77a4-4c08-9c13-740e307df956 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:37.434893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbbaca-1f43-44ac-ad8f-751fe2ece10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:37.435603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbbaca-1f43-44ac-ad8f-751fe2ece10f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.435887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbbaca-1f43-44ac-ad8f-751fe2ece10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.436160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbbaca-1f43-44ac-ad8f-751fe2ece10f admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.437248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbbaca-1f43-44ac-ad8f-751fe2ece10f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:37.437628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbbaca-1f43-44ac-ad8f-751fe2ece10f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:37.439822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbbaca-1f43-44ac-ad8f-751fe2ece10f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:37.465689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1051/2106] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:09:37.474793 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46dca6-6366-4808-a14c-b6c7274acb80 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:37.479591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46dca6-6366-4808-a14c-b6c7274acb80 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:37.485866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d982f-8d85-4221-9952-5574acbb2a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:37.486749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d982f-8d85-4221-9952-5574acbb2a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.487044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d982f-8d85-4221-9952-5574acbb2a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.487323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d982f-8d85-4221-9952-5574acbb2a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.488031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d982f-8d85-4221-9952-5574acbb2a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:37.490022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d982f-8d85-4221-9952-5574acbb2a4e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:37.522338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1056/2107] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:37 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:37.526469 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbbaca-1f43-44ac-ad8f-751fe2ece10f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:37.536949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbbaca-1f43-44ac-ad8f-751fe2ece10f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:37.595734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a831966-37fe-4a17-8966-d9a88f880084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:37.596568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a831966-37fe-4a17-8966-d9a88f880084 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.596854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a831966-37fe-4a17-8966-d9a88f880084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.597131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a831966-37fe-4a17-8966-d9a88f880084 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.597857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a831966-37fe-4a17-8966-d9a88f880084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:37.599884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a831966-37fe-4a17-8966-d9a88f880084 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:37.620363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1052/2108] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:37 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:37.624542 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d982f-8d85-4221-9952-5574acbb2a4e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:37.635025 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d982f-8d85-4221-9952-5574acbb2a4e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:37.639497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a73ad-b960-4559-ab79-51c43a5d75d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:37.640252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a73ad-b960-4559-ab79-51c43a5d75d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.640699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a73ad-b960-4559-ab79-51c43a5d75d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.640978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a73ad-b960-4559-ab79-51c43a5d75d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.641692 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a73ad-b960-4559-ab79-51c43a5d75d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:37.643318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a73ad-b960-4559-ab79-51c43a5d75d6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:37.654665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1057/2109] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:37.659543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a831966-37fe-4a17-8966-d9a88f880084 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:37.669449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a831966-37fe-4a17-8966-d9a88f880084 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:37.675389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3151eb3-7f49-4b13-8cea-a1d4c7af51b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:37.676053 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151eb3-7f49-4b13-8cea-a1d4c7af51b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.676338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151eb3-7f49-4b13-8cea-a1d4c7af51b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.676612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151eb3-7f49-4b13-8cea-a1d4c7af51b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.677339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3151eb3-7f49-4b13-8cea-a1d4c7af51b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:37.678996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3151eb3-7f49-4b13-8cea-a1d4c7af51b3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:37.689879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1053/2110] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:37.694062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a73ad-b960-4559-ab79-51c43a5d75d6 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:37.703976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a73ad-b960-4559-ab79-51c43a5d75d6 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:37.708627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578b0a6-d070-4dd3-a1d9-a354465d6053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:37.709435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b0a6-d070-4dd3-a1d9-a354465d6053 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.709719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b0a6-d070-4dd3-a1d9-a354465d6053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.709992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b0a6-d070-4dd3-a1d9-a354465d6053 admin admin] PATH_INFO: `/v3/projects/7672fb79123a485d9420b33bb6dca6af/users/1110aa5c5d95441db47f0107bbace9fb/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.725149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578b0a6-d070-4dd3-a1d9-a354465d6053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7672fb79123a485d9420b33bb6dca6af, user_id=1110aa5c5d95441db47f0107bbace9fb, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:37.727824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578b0a6-d070-4dd3-a1d9-a354465d6053 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:37.741148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1058/2111] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:37 2022] PUT /identity/v3/projects/7672fb79123a485d9420b33bb6dca6af/users/1110aa5c5d95441db47f0107bbace9fb/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:37.751835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff127f7-f97a-4b35-a67c-e76729a29275 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.752128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff127f7-f97a-4b35-a67c-e76729a29275 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.752405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff127f7-f97a-4b35-a67c-e76729a29275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.778909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-eff127f7-f97a-4b35-a67c-e76729a29275 None None] MFA Rules not processed for user `1110aa5c5d95441db47f0107bbace9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:37.780109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-eff127f7-f97a-4b35-a67c-e76729a29275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:37.818097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:37.855432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1054/2112] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:37.860676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578b0a6-d070-4dd3-a1d9-a354465d6053 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:37.928596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578b0a6-d070-4dd3-a1d9-a354465d6053 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:37.933706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecdfed-c05c-4c4d-889f-4b23fb027120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:37.934299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecdfed-c05c-4c4d-889f-4b23fb027120 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:37.934583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecdfed-c05c-4c4d-889f-4b23fb027120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:37.934965 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecdfed-c05c-4c4d-889f-4b23fb027120 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:37.935674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecdfed-c05c-4c4d-889f-4b23fb027120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:37.937961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecdfed-c05c-4c4d-889f-4b23fb027120 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:37.966590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1059/2113] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:37 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:37.971395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff127f7-f97a-4b35-a67c-e76729a29275 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:37.982965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff127f7-f97a-4b35-a67c-e76729a29275 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.040796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaa404-b0d2-440c-adea-945d3bd9e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.041466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaa404-b0d2-440c-adea-945d3bd9e2bf admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.041753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaa404-b0d2-440c-adea-945d3bd9e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.042030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaa404-b0d2-440c-adea-945d3bd9e2bf admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.042749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaa404-b0d2-440c-adea-945d3bd9e2bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.044675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaa404-b0d2-440c-adea-945d3bd9e2bf admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.065643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1055/2114] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:37 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:38.070007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecdfed-c05c-4c4d-889f-4b23fb027120 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:38.080923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecdfed-c05c-4c4d-889f-4b23fb027120 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.085866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4f5e9-58e2-4e45-a70c-2403be9f6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.086597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4f5e9-58e2-4e45-a70c-2403be9f6625 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.086953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4f5e9-58e2-4e45-a70c-2403be9f6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.087284 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4f5e9-58e2-4e45-a70c-2403be9f6625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.088096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4f5e9-58e2-4e45-a70c-2403be9f6625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.090087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4f5e9-58e2-4e45-a70c-2403be9f6625 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.101163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1060/2115] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:38.105328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaa404-b0d2-440c-adea-945d3bd9e2bf admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:38.116116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaa404-b0d2-440c-adea-945d3bd9e2bf admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.120680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e8864-08f7-4fa0-87e5-4975bad4bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.121339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e8864-08f7-4fa0-87e5-4975bad4bd82 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.121618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e8864-08f7-4fa0-87e5-4975bad4bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.121889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e8864-08f7-4fa0-87e5-4975bad4bd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.122612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e8864-08f7-4fa0-87e5-4975bad4bd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.124275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e8864-08f7-4fa0-87e5-4975bad4bd82 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.135062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1056/2116] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:09:38.139106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4f5e9-58e2-4e45-a70c-2403be9f6625 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:38.149393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4f5e9-58e2-4e45-a70c-2403be9f6625 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.153967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459cad3-032f-43d4-a8c2-15e4a8b83387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.154871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459cad3-032f-43d4-a8c2-15e4a8b83387 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.155158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459cad3-032f-43d4-a8c2-15e4a8b83387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.155455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459cad3-032f-43d4-a8c2-15e4a8b83387 admin admin] PATH_INFO: `/v3/projects/c29ea7781a544589b1dba7cf357e3809/users/74125bbf7755447a8f8f729ca802a907/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.169948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459cad3-032f-43d4-a8c2-15e4a8b83387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29ea7781a544589b1dba7cf357e3809, user_id=74125bbf7755447a8f8f729ca802a907, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.174363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459cad3-032f-43d4-a8c2-15e4a8b83387 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.189742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1061/2117] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:38 2022] PUT /identity/v3/projects/c29ea7781a544589b1dba7cf357e3809/users/74125bbf7755447a8f8f729ca802a907/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:38.200933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccb745-975f-4ef3-a934-280493f306be None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.201228 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccb745-975f-4ef3-a934-280493f306be None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.201500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccb745-975f-4ef3-a934-280493f306be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.229327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d0ccb745-975f-4ef3-a934-280493f306be None None] MFA Rules not processed for user `74125bbf7755447a8f8f729ca802a907`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:38.230522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d0ccb745-975f-4ef3-a934-280493f306be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:38.294409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1057/2118] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:38.299591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459cad3-032f-43d4-a8c2-15e4a8b83387 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:38.317435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:38.364802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459cad3-032f-43d4-a8c2-15e4a8b83387 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.370056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d8394-0c51-4335-901f-0e6b4dbd82f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.370741 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d8394-0c51-4335-901f-0e6b4dbd82f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.371029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d8394-0c51-4335-901f-0e6b4dbd82f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.371300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d8394-0c51-4335-901f-0e6b4dbd82f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.372078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d8394-0c51-4335-901f-0e6b4dbd82f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.374085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d8394-0c51-4335-901f-0e6b4dbd82f7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.399787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1062/2119] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:38 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:38.404139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccb745-975f-4ef3-a934-280493f306be None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:38.415769 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccb745-975f-4ef3-a934-280493f306be None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.458581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:38.479897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c63256-5dc8-4875-a2ac-3ee46db4def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.480679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c63256-5dc8-4875-a2ac-3ee46db4def4 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.481059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c63256-5dc8-4875-a2ac-3ee46db4def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.481466 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c63256-5dc8-4875-a2ac-3ee46db4def4 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.482255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c63256-5dc8-4875-a2ac-3ee46db4def4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.485483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c63256-5dc8-4875-a2ac-3ee46db4def4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.515333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1058/2120] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:38 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:38.519950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d8394-0c51-4335-901f-0e6b4dbd82f7 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:38.532967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d8394-0c51-4335-901f-0e6b4dbd82f7 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.538286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25947ab-ca8e-4e17-9631-ed6538a927d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.539020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25947ab-ca8e-4e17-9631-ed6538a927d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.539359 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25947ab-ca8e-4e17-9631-ed6538a927d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.539642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25947ab-ca8e-4e17-9631-ed6538a927d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.540368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25947ab-ca8e-4e17-9631-ed6538a927d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.542094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25947ab-ca8e-4e17-9631-ed6538a927d3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.553455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1063/2121] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:38.557779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c63256-5dc8-4875-a2ac-3ee46db4def4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:38.568587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c63256-5dc8-4875-a2ac-3ee46db4def4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.573392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c57179-55d0-4bb3-ae31-1bce9487c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.574280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c57179-55d0-4bb3-ae31-1bce9487c157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.574563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c57179-55d0-4bb3-ae31-1bce9487c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.574871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c57179-55d0-4bb3-ae31-1bce9487c157 admin admin] PATH_INFO: `/v3/projects/310e7cbd312540cdb741a5b2bd59c3c6/users/1a259cf289fc476f94a937d8189f9b97/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.590578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c57179-55d0-4bb3-ae31-1bce9487c157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310e7cbd312540cdb741a5b2bd59c3c6, user_id=1a259cf289fc476f94a937d8189f9b97, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.593317 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c57179-55d0-4bb3-ae31-1bce9487c157 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.605893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1059/2122] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:38 2022] PUT /identity/v3/projects/310e7cbd312540cdb741a5b2bd59c3c6/users/1a259cf289fc476f94a937d8189f9b97/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:38.610105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25947ab-ca8e-4e17-9631-ed6538a927d3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:38.621244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25947ab-ca8e-4e17-9631-ed6538a927d3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.678739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589be5b-8e05-4d55-b3b7-68d36050dcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.679400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589be5b-8e05-4d55-b3b7-68d36050dcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.679679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589be5b-8e05-4d55-b3b7-68d36050dcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.679952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589be5b-8e05-4d55-b3b7-68d36050dcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.680660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589be5b-8e05-4d55-b3b7-68d36050dcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.682267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589be5b-8e05-4d55-b3b7-68d36050dcd5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.692652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1064/2123] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:09:38.696845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c57179-55d0-4bb3-ae31-1bce9487c157 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:38.707794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c57179-55d0-4bb3-ae31-1bce9487c157 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.712392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342054f8-f35d-4ed7-827c-4c6087c198fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.713268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342054f8-f35d-4ed7-827c-4c6087c198fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.713552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342054f8-f35d-4ed7-827c-4c6087c198fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.713828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342054f8-f35d-4ed7-827c-4c6087c198fc admin admin] PATH_INFO: `/v3/projects/310e7cbd312540cdb741a5b2bd59c3c6/users/1a259cf289fc476f94a937d8189f9b97/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.715805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342054f8-f35d-4ed7-827c-4c6087c198fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=310e7cbd312540cdb741a5b2bd59c3c6, user_id=1a259cf289fc476f94a937d8189f9b97, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.718509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342054f8-f35d-4ed7-827c-4c6087c198fc admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.728712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1060/2124] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:38 2022] PUT /identity/v3/projects/310e7cbd312540cdb741a5b2bd59c3c6/users/1a259cf289fc476f94a937d8189f9b97/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:38.739169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b53937-05a5-449b-95bf-d34876d7b741 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.739461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b53937-05a5-449b-95bf-d34876d7b741 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.739742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b53937-05a5-449b-95bf-d34876d7b741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.766363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-82b53937-05a5-449b-95bf-d34876d7b741 None None] MFA Rules not processed for user `1a259cf289fc476f94a937d8189f9b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:38.767609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-82b53937-05a5-449b-95bf-d34876d7b741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:38.834984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1065/2125] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:38.846148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342054f8-f35d-4ed7-827c-4c6087c198fc admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:38.847869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-342054f8-f35d-4ed7-827c-4c6087c198fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:38.903823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342054f8-f35d-4ed7-827c-4c6087c198fc admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:38.907840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a2ee-a025-4c49-aa44-7d9c4be141ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:38.908470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a2ee-a025-4c49-aa44-7d9c4be141ba service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:38.908753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a2ee-a025-4c49-aa44-7d9c4be141ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:38.909028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a2ee-a025-4c49-aa44-7d9c4be141ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:38.972238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83a2ee-a025-4c49-aa44-7d9c4be141ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:38.973674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83a2ee-a025-4c49-aa44-7d9c4be141ba service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:38.982613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1061/2126] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:44.263236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b53937-05a5-449b-95bf-d34876d7b741 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:44.264622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-82b53937-05a5-449b-95bf-d34876d7b741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:44.277732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:44.405371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b53937-05a5-449b-95bf-d34876d7b741 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:44.410220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:44.411128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:44.411409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:44.411684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] PATH_INFO: `/v3/users/7c00fc4e1c874cc2939d4e4f91e1a6e5` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:44.412869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c00fc4e1c874cc2939d4e4f91e1a6e5)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:44.414816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:44.462383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c00fc4e1c874cc2939d4e4f91e1a6e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:44.470000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c00fc4e1c874cc2939d4e4f91e1a6e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:44.470690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c00fc4e1c874cc2939d4e4f91e1a6e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:44.471324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c00fc4e1c874cc2939d4e4f91e1a6e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:44.483151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c00fc4e1c874cc2939d4e4f91e1a6e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:44.496882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1066/2127] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:44 2022] DELETE /identity/v3/users/7c00fc4e1c874cc2939d4e4f91e1a6e5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:44.502031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd629344-ac65-4882-869c-d0caf4b925a6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:44.502560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd629344-ac65-4882-869c-d0caf4b925a6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:44.502838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd629344-ac65-4882-869c-d0caf4b925a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:44.533039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-bd629344-ac65-4882-869c-d0caf4b925a6 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:44.534240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bd629344-ac65-4882-869c-d0caf4b925a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:44.580636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:44.601002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1062/2128] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:44.611137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:44.612657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:44.651622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:44.666933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd629344-ac65-4882-869c-d0caf4b925a6 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:44.668590 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bd629344-ac65-4882-869c-d0caf4b925a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:44.740337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd629344-ac65-4882-869c-d0caf4b925a6 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:44.741133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2c9df-289d-4ca0-baeb-81ec4b7eb0f9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:44.743946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3d0e-baf2-4e7e-851c-0dd67d7f4285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:44.744592 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3d0e-baf2-4e7e-851c-0dd67d7f4285 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:44.744870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3d0e-baf2-4e7e-851c-0dd67d7f4285 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:44.745196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3d0e-baf2-4e7e-851c-0dd67d7f4285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:44.745548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26385b6-4f71-4edc-9f24-1213d23566ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:44.746200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26385b6-4f71-4edc-9f24-1213d23566ef service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:44.746485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26385b6-4f71-4edc-9f24-1213d23566ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:44.746797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26385b6-4f71-4edc-9f24-1213d23566ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:44.747069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-770f3d0e-baf2-4e7e-851c-0dd67d7f4285 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:44.759954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26385b6-4f71-4edc-9f24-1213d23566ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:44.761540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26385b6-4f71-4edc-9f24-1213d23566ef service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:44.772317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1067/2129] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:44.829445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f3d0e-baf2-4e7e-851c-0dd67d7f4285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:44.830996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f3d0e-baf2-4e7e-851c-0dd67d7f4285 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:44.847598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1063/2130] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:09:45.277257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26385b6-4f71-4edc-9f24-1213d23566ef service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:45.279075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a26385b6-4f71-4edc-9f24-1213d23566ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:45.309075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26385b6-4f71-4edc-9f24-1213d23566ef service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:45.320732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:45.321646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:45.321931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:45.322440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] PATH_INFO: `/v3/projects/e799f3082f7a4f17b09be46bfbfeed67` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:45.323668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e799f3082f7a4f17b09be46bfbfeed67)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:45.325576 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:45.382514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e799f3082f7a4f17b09be46bfbfeed67', 'request_id': 'req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.390744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e799f3082f7a4f17b09be46bfbfeed67', 'request_id': 'req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.397516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e799f3082f7a4f17b09be46bfbfeed67', 'request_id': 'req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.420255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] The token cache is being invalidate because project e799f3082f7a4f17b09be46bfbfeed67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:45.420569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.422104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d4f5e7da-a34a-4b0d-a8b7-89a799b409e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.426775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1068/2131] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:45 2022] DELETE /identity/v3/projects/e799f3082f7a4f17b09be46bfbfeed67 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:45.429984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3d0e-baf2-4e7e-851c-0dd67d7f4285 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:45.441844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3d0e-baf2-4e7e-851c-0dd67d7f4285 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:45.516636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:45.517719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:45.518950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:45.519360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] PATH_INFO: `/v3/users/95027d9f4b6e41e0b97151efae9c679a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:45.520768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95027d9f4b6e41e0b97151efae9c679a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:45.522738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:45.591128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:45.598529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95027d9f4b6e41e0b97151efae9c679a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.599226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95027d9f4b6e41e0b97151efae9c679a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.606321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95027d9f4b6e41e0b97151efae9c679a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.606990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95027d9f4b6e41e0b97151efae9c679a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.621724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-51749f1f-a612-45a9-be3a-08392a83a768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95027d9f4b6e41e0b97151efae9c679a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.637837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1064/2132] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:45 2022] DELETE /identity/v3/users/95027d9f4b6e41e0b97151efae9c679a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:45.680017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db8c9-50a5-4e3f-acf2-c2479b346aee None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:45.680315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db8c9-50a5-4e3f-acf2-c2479b346aee None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:45.681036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db8c9-50a5-4e3f-acf2-c2479b346aee None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:45.682613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1069/2133] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 18:09:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:09:45.693113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff7595-06e7-4c29-a5b5-22895156367a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:45.693534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff7595-06e7-4c29-a5b5-22895156367a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:45.694004 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff7595-06e7-4c29-a5b5-22895156367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:45.713088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-26ff7595-06e7-4c29-a5b5-22895156367a None None] MFA Rules not processed for user `77e042a473204d358e3b0682bf1338d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:45.714570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-26ff7595-06e7-4c29-a5b5-22895156367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:45.765845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db8c9-50a5-4e3f-acf2-c2479b346aee None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:45.767892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2a2db8c9-50a5-4e3f-acf2-c2479b346aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:45.800695 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1065/2134] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 18:09:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:45.811642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff7595-06e7-4c29-a5b5-22895156367a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:45.813664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-26ff7595-06e7-4c29-a5b5-22895156367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:45.831507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff7595-06e7-4c29-a5b5-22895156367a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:45.837271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d63a2-4ed4-4af0-9bba-8580faad0626 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:45.837728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d63a2-4ed4-4af0-9bba-8580faad0626 service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:45.838049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d63a2-4ed4-4af0-9bba-8580faad0626 service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:45.838271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d63a2-4ed4-4af0-9bba-8580faad0626 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:45.850404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d63a2-4ed4-4af0-9bba-8580faad0626 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:45.852756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d63a2-4ed4-4af0-9bba-8580faad0626 service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:45.865074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1066/2135] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:45.869205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db8c9-50a5-4e3f-acf2-c2479b346aee None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:45.875395 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:45.876491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:45.876899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:45.877249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] PATH_INFO: `/v3/users/38349aaa207c4703a18f512ad2f95196` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:45.878735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38349aaa207c4703a18f512ad2f95196)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:45.881073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:45.918312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:45.956146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38349aaa207c4703a18f512ad2f95196'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.966156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38349aaa207c4703a18f512ad2f95196'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.966953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38349aaa207c4703a18f512ad2f95196'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.971777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38349aaa207c4703a18f512ad2f95196'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:45.971936 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d63a2-4ed4-4af0-9bba-8580faad0626 service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:45.973947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fb8d63a2-4ed4-4af0-9bba-8580faad0626 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:45.992835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d63a2-4ed4-4af0-9bba-8580faad0626 service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:45.994880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7e7543e6-7724-411a-ac3e-8738a591c97c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38349aaa207c4703a18f512ad2f95196'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.003324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.004345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.004659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.004991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] PATH_INFO: `/v3/projects/ece13074014e41418703c18d4296541b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.006252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece13074014e41418703c18d4296541b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.008621 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.016637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1070/2136] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:45 2022] DELETE /identity/v3/users/38349aaa207c4703a18f512ad2f95196 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:46.073539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece13074014e41418703c18d4296541b', 'request_id': 'req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.082291 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece13074014e41418703c18d4296541b', 'request_id': 'req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.090624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece13074014e41418703c18d4296541b', 'request_id': 'req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.110230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] The token cache is being invalidate because project ece13074014e41418703c18d4296541b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:46.110722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.111423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.113861 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1067/2137] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:45 2022] DELETE /identity/v3/projects/ece13074014e41418703c18d4296541b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:46.118511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde9837-a3cd-4efd-b4ea-07e479707972 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.118852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde9837-a3cd-4efd-b4ea-07e479707972 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.119135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde9837-a3cd-4efd-b4ea-07e479707972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.165932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7cde9837-a3cd-4efd-b4ea-07e479707972 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:46.167184 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7cde9837-a3cd-4efd-b4ea-07e479707972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:46.183873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.185275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:46.223117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:46.251951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1071/2138] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:46.259767 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde9837-a3cd-4efd-b4ea-07e479707972 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.261862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7cde9837-a3cd-4efd-b4ea-07e479707972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:46.275261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde9837-a3cd-4efd-b4ea-07e479707972 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.279787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c3b80-f40e-427a-bc59-ccebf2dfe7ae admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.281093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.281948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.282220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.282500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] PATH_INFO: `/v3/projects/b3e941f449f34bcaa50de8b5d87b9389` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.283843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e941f449f34bcaa50de8b5d87b9389)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.285969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.286292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1f100-8430-41bd-9a03-9d5c71b3e20e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.286968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1f100-8430-41bd-9a03-9d5c71b3e20e service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.287239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1f100-8430-41bd-9a03-9d5c71b3e20e service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.287682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1f100-8430-41bd-9a03-9d5c71b3e20e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.289312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c6e1f100-8430-41bd-9a03-9d5c71b3e20e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:46.347018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e941f449f34bcaa50de8b5d87b9389', 'request_id': 'req-49861740-7906-4542-9d22-21033b58c55c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.355315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e941f449f34bcaa50de8b5d87b9389', 'request_id': 'req-49861740-7906-4542-9d22-21033b58c55c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.363553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e941f449f34bcaa50de8b5d87b9389', 'request_id': 'req-49861740-7906-4542-9d22-21033b58c55c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.367143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1f100-8430-41bd-9a03-9d5c71b3e20e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.368582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1f100-8430-41bd-9a03-9d5c71b3e20e service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.380642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] The token cache is being invalidate because project b3e941f449f34bcaa50de8b5d87b9389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:46.381280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.382331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-49861740-7906-4542-9d22-21033b58c55c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:46.382970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1068/2139] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:09:46.384409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1072/2140] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:46 2022] DELETE /identity/v3/projects/b3e941f449f34bcaa50de8b5d87b9389 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:46.384525 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29652-2895-4374-b260-f89032c11452 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.384730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29652-2895-4374-b260-f89032c11452 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.385023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b29652-2895-4374-b260-f89032c11452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.389637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a219b61-69d3-4917-b36a-a99fead0f5b6 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.390076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a219b61-69d3-4917-b36a-a99fead0f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.391412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a219b61-69d3-4917-b36a-a99fead0f5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.403194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e9b29652-2895-4374-b260-f89032c11452 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:46.404399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e9b29652-2895-4374-b260-f89032c11452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:46.407292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:46.414549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9a219b61-69d3-4917-b36a-a99fead0f5b6 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:46.417982 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9a219b61-69d3-4917-b36a-a99fead0f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:46.477442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1069/2141] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:46.481880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29652-2895-4374-b260-f89032c11452 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.492231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b29652-2895-4374-b260-f89032c11452 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.496793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312879-7d07-4e75-b716-bbcc94d8e2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.497437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312879-7d07-4e75-b716-bbcc94d8e2db admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.497720 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312879-7d07-4e75-b716-bbcc94d8e2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.497998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312879-7d07-4e75-b716-bbcc94d8e2db admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.498935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00312879-7d07-4e75-b716-bbcc94d8e2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:46.500009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00312879-7d07-4e75-b716-bbcc94d8e2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.501427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1073/2142] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:46.502906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00312879-7d07-4e75-b716-bbcc94d8e2db admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.509460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103160d-8a4d-4864-869d-cda7c96da427 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.509752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103160d-8a4d-4864-869d-cda7c96da427 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.510033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103160d-8a4d-4864-869d-cda7c96da427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.517666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1070/2143] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:09:46.523003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312879-7d07-4e75-b716-bbcc94d8e2db admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.530258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312879-7d07-4e75-b716-bbcc94d8e2db admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.534914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734e84-23cf-461d-8d45-b81b6b31b87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.535568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734e84-23cf-461d-8d45-b81b6b31b87e admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.535856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734e84-23cf-461d-8d45-b81b6b31b87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.536135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734e84-23cf-461d-8d45-b81b6b31b87e admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.536348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9103160d-8a4d-4864-869d-cda7c96da427 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:46.536820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89734e84-23cf-461d-8d45-b81b6b31b87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.537548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9103160d-8a4d-4864-869d-cda7c96da427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:46.538745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89734e84-23cf-461d-8d45-b81b6b31b87e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.545528 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1074/2144] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:46.550252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103160d-8a4d-4864-869d-cda7c96da427 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.559398 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103160d-8a4d-4864-869d-cda7c96da427 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.564816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ca87f-bba9-46e8-973d-bc0449ec4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.565469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ca87f-bba9-46e8-973d-bc0449ec4c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.565754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ca87f-bba9-46e8-973d-bc0449ec4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.566057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ca87f-bba9-46e8-973d-bc0449ec4c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.569677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1071/2145] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:46 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:46.569828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ca87f-bba9-46e8-973d-bc0449ec4c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:46.569828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ca87f-bba9-46e8-973d-bc0449ec4c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.569828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ca87f-bba9-46e8-973d-bc0449ec4c20 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.570612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734e84-23cf-461d-8d45-b81b6b31b87e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.582116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1075/2146] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:09:46.591962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ca87f-bba9-46e8-973d-bc0449ec4c20 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.603688 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ca87f-bba9-46e8-973d-bc0449ec4c20 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.624865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:46.649830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734e84-23cf-461d-8d45-b81b6b31b87e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.656697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d9c16-4f1f-4a26-b667-849d52011a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.657753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d9c16-4f1f-4a26-b667-849d52011a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.658136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d9c16-4f1f-4a26-b667-849d52011a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.658484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d9c16-4f1f-4a26-b667-849d52011a19 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.659417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d9c16-4f1f-4a26-b667-849d52011a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.661362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d9c16-4f1f-4a26-b667-849d52011a19 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.670234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387203af-2680-4324-b727-c712052e0ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.672285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387203af-2680-4324-b727-c712052e0ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.673022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387203af-2680-4324-b727-c712052e0ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.673446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387203af-2680-4324-b727-c712052e0ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.674468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387203af-2680-4324-b727-c712052e0ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.676676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387203af-2680-4324-b727-c712052e0ed3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.685180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1072/2147] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:46 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:46.690095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d9c16-4f1f-4a26-b667-849d52011a19 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.701365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d9c16-4f1f-4a26-b667-849d52011a19 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.706183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d8fa0-49d7-4466-a3ff-9dbd8cb70fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.706878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d8fa0-49d7-4466-a3ff-9dbd8cb70fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.707161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d8fa0-49d7-4466-a3ff-9dbd8cb70fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.707435 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d8fa0-49d7-4466-a3ff-9dbd8cb70fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.707690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1076/2148] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:46 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:46.708296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d8fa0-49d7-4466-a3ff-9dbd8cb70fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.709971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d8fa0-49d7-4466-a3ff-9dbd8cb70fb2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.715624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387203af-2680-4324-b727-c712052e0ed3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.728945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1073/2149] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:46.731241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d8fa0-49d7-4466-a3ff-9dbd8cb70fb2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.748587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d8fa0-49d7-4466-a3ff-9dbd8cb70fb2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.800354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387203af-2680-4324-b727-c712052e0ed3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.805076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c793a-7ffc-42a4-8600-b875bbce76c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.805788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c793a-7ffc-42a4-8600-b875bbce76c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.806070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c793a-7ffc-42a4-8600-b875bbce76c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.806345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c793a-7ffc-42a4-8600-b875bbce76c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.807070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c793a-7ffc-42a4-8600-b875bbce76c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.809004 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c793a-7ffc-42a4-8600-b875bbce76c5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.817047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16487eac-bd5c-4ac6-a095-e164ab40724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.817813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16487eac-bd5c-4ac6-a095-e164ab40724a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.818095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16487eac-bd5c-4ac6-a095-e164ab40724a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.818363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16487eac-bd5c-4ac6-a095-e164ab40724a admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.819204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16487eac-bd5c-4ac6-a095-e164ab40724a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.821475 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16487eac-bd5c-4ac6-a095-e164ab40724a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.835188 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1074/2150] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:46.835413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1077/2151] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:46 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:46.836226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16487eac-bd5c-4ac6-a095-e164ab40724a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.839341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c793a-7ffc-42a4-8600-b875bbce76c5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.845386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:46.847260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16487eac-bd5c-4ac6-a095-e164ab40724a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.852373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b2d1-bf89-49ba-af84-0db6060c9df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.852547 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c793a-7ffc-42a4-8600-b875bbce76c5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.853039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b2d1-bf89-49ba-af84-0db6060c9df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.853544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b2d1-bf89-49ba-af84-0db6060c9df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.853822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3b2d1-bf89-49ba-af84-0db6060c9df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.854599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3b2d1-bf89-49ba-af84-0db6060c9df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.856422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3b2d1-bf89-49ba-af84-0db6060c9df6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.859337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1971-0806-44cf-b111-35605be53ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.860476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1971-0806-44cf-b111-35605be53ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.860759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1971-0806-44cf-b111-35605be53ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.861033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1971-0806-44cf-b111-35605be53ef4 admin admin] PATH_INFO: `/v3/projects/1d9193f4feb14b0a8e562eeaec2457ff/users/bd322bf8a9004f259337fe7e91efec14/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.868654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1075/2152] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:46.872727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b2d1-bf89-49ba-af84-0db6060c9df6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.879623 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb1971-0806-44cf-b111-35605be53ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9193f4feb14b0a8e562eeaec2457ff, user_id=bd322bf8a9004f259337fe7e91efec14, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.882950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb1971-0806-44cf-b111-35605be53ef4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.884566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3b2d1-bf89-49ba-af84-0db6060c9df6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.892450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523594d2-6770-4fbb-98ab-dfabe1ef3612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.893220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523594d2-6770-4fbb-98ab-dfabe1ef3612 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.893571 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523594d2-6770-4fbb-98ab-dfabe1ef3612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.894083 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523594d2-6770-4fbb-98ab-dfabe1ef3612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.894679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523594d2-6770-4fbb-98ab-dfabe1ef3612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:46.896436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523594d2-6770-4fbb-98ab-dfabe1ef3612 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:46.899564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1078/2153] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:46 2022] PUT /identity/v3/projects/1d9193f4feb14b0a8e562eeaec2457ff/users/bd322bf8a9004f259337fe7e91efec14/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:46.909490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1076/2154] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:09:46.913708 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1971-0806-44cf-b111-35605be53ef4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:46.917773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46e831-6126-4bcd-91fa-85bc87652d6a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.918069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46e831-6126-4bcd-91fa-85bc87652d6a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.918345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46e831-6126-4bcd-91fa-85bc87652d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:46.946664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4b46e831-6126-4bcd-91fa-85bc87652d6a None None] MFA Rules not processed for user `bd322bf8a9004f259337fe7e91efec14`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:46.947907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4b46e831-6126-4bcd-91fa-85bc87652d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:46.988526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1971-0806-44cf-b111-35605be53ef4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:46.995346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b0193-b97c-4934-9780-ae773acb38cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:46.996243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b0193-b97c-4934-9780-ae773acb38cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:46.996531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b0193-b97c-4934-9780-ae773acb38cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:46.996866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b0193-b97c-4934-9780-ae773acb38cb admin admin] PATH_INFO: `/v3/projects/4e53b5c27ff1492cba01bdb3ba6a60dc/users/45f8798b1437441aa059236a21bdfd59/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.018321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b0193-b97c-4934-9780-ae773acb38cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e53b5c27ff1492cba01bdb3ba6a60dc, user_id=45f8798b1437441aa059236a21bdfd59, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:47.021467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b0193-b97c-4934-9780-ae773acb38cb admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:47.028578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1077/2155] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:47.029465 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46e831-6126-4bcd-91fa-85bc87652d6a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:47.039481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1079/2156] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:46 2022] PUT /identity/v3/projects/4e53b5c27ff1492cba01bdb3ba6a60dc/users/45f8798b1437441aa059236a21bdfd59/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:47.041007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46e831-6126-4bcd-91fa-85bc87652d6a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:47.056114 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c111-b60a-49e6-a2a2-bf2b71e2896d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:47.056410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c111-b60a-49e6-a2a2-bf2b71e2896d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:47.056693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c111-b60a-49e6-a2a2-bf2b71e2896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.066023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:47.091306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b325c111-b60a-49e6-a2a2-bf2b71e2896d None None] MFA Rules not processed for user `45f8798b1437441aa059236a21bdfd59`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:47.093571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b325c111-b60a-49e6-a2a2-bf2b71e2896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:47.109462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4342aa-5371-477a-b9b3-2200b618ff31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:47.110129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4342aa-5371-477a-b9b3-2200b618ff31 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:47.110414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4342aa-5371-477a-b9b3-2200b618ff31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:47.110725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4342aa-5371-477a-b9b3-2200b618ff31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.111419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4342aa-5371-477a-b9b3-2200b618ff31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:47.113406 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4342aa-5371-477a-b9b3-2200b618ff31 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:47.141906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1078/2157] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:47 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:47.145993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4342aa-5371-477a-b9b3-2200b618ff31 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:47.176113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1080/2158] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:09:47.183146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325c111-b60a-49e6-a2a2-bf2b71e2896d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:47.184527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b325c111-b60a-49e6-a2a2-bf2b71e2896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:47.213834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4342aa-5371-477a-b9b3-2200b618ff31 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:47.220673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85beac5-60b1-456d-8b13-08e8bed461a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:47.221759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85beac5-60b1-456d-8b13-08e8bed461a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:47.222260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85beac5-60b1-456d-8b13-08e8bed461a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:47.222728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85beac5-60b1-456d-8b13-08e8bed461a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.223929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85beac5-60b1-456d-8b13-08e8bed461a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:47.226457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85beac5-60b1-456d-8b13-08e8bed461a7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:47.240891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:47.253975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1079/2159] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:47 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:47.255169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85beac5-60b1-456d-8b13-08e8bed461a7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:47.266650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85beac5-60b1-456d-8b13-08e8bed461a7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:47.267493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325c111-b60a-49e6-a2a2-bf2b71e2896d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:47.271892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cfb41-c95f-4910-8a8b-a4e01c2223ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:47.272565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cfb41-c95f-4910-8a8b-a4e01c2223ac admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:47.272845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cfb41-c95f-4910-8a8b-a4e01c2223ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:47.273708 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cfb41-c95f-4910-8a8b-a4e01c2223ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.274473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cfb41-c95f-4910-8a8b-a4e01c2223ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:47.276459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cfb41-c95f-4910-8a8b-a4e01c2223ac admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:47.291975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1080/2160] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:09:47.292844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cfb41-c95f-4910-8a8b-a4e01c2223ac admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:47.303931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cfb41-c95f-4910-8a8b-a4e01c2223ac admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:47.309104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45963f6-c728-4ef7-95a7-a7550a8e4011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:47.310098 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45963f6-c728-4ef7-95a7-a7550a8e4011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:47.310494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45963f6-c728-4ef7-95a7-a7550a8e4011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:47.310998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45963f6-c728-4ef7-95a7-a7550a8e4011 admin admin] PATH_INFO: `/v3/projects/264ab8db85e34f6386daf029090ee29c/users/98adb3810b7a401fb37d73354430500a/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.333174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45963f6-c728-4ef7-95a7-a7550a8e4011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264ab8db85e34f6386daf029090ee29c, user_id=98adb3810b7a401fb37d73354430500a, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:47.337534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45963f6-c728-4ef7-95a7-a7550a8e4011 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:47.345442 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a55bd-dc76-4f39-a6da-2efe34ba2437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:47.346097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a55bd-dc76-4f39-a6da-2efe34ba2437 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:47.346438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a55bd-dc76-4f39-a6da-2efe34ba2437 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:47.346668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a55bd-dc76-4f39-a6da-2efe34ba2437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.354144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1081/2161] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:47 2022] PUT /identity/v3/projects/264ab8db85e34f6386daf029090ee29c/users/98adb3810b7a401fb37d73354430500a/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:47.359169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45963f6-c728-4ef7-95a7-a7550a8e4011 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:47.413459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a55bd-dc76-4f39-a6da-2efe34ba2437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:47.415718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a55bd-dc76-4f39-a6da-2efe34ba2437 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:47.430326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1081/2162] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:09:47.451798 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45963f6-c728-4ef7-95a7-a7550a8e4011 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:47.459361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a724726-e5b4-4891-a4c1-19473dc54a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:47.460045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a724726-e5b4-4891-a4c1-19473dc54a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:47.460334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a724726-e5b4-4891-a4c1-19473dc54a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:47.460613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a724726-e5b4-4891-a4c1-19473dc54a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.461352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a724726-e5b4-4891-a4c1-19473dc54a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:47.462988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a724726-e5b4-4891-a4c1-19473dc54a74 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:47.465404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:47.476657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1082/2163] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:09:47.482190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a55bd-dc76-4f39-a6da-2efe34ba2437 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:47.494102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a55bd-dc76-4f39-a6da-2efe34ba2437 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:47.500209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360a41a-a582-4721-9602-bbf183a7082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:47.501274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360a41a-a582-4721-9602-bbf183a7082d admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:47.501714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360a41a-a582-4721-9602-bbf183a7082d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:47.502280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360a41a-a582-4721-9602-bbf183a7082d admin admin] PATH_INFO: `/v3/projects/264ab8db85e34f6386daf029090ee29c/users/98adb3810b7a401fb37d73354430500a/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.506554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360a41a-a582-4721-9602-bbf183a7082d admin admin] RBAC: Authorizing `identity:create_grant(project_id=264ab8db85e34f6386daf029090ee29c, user_id=98adb3810b7a401fb37d73354430500a, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:47.510016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360a41a-a582-4721-9602-bbf183a7082d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:47.533807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1082/2164] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:47 2022] PUT /identity/v3/projects/264ab8db85e34f6386daf029090ee29c/users/98adb3810b7a401fb37d73354430500a/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:47.543980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5abc9a-9ea8-4ce3-b874-664e234ae178 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:47.544417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5abc9a-9ea8-4ce3-b874-664e234ae178 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:47.544541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5abc9a-9ea8-4ce3-b874-664e234ae178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.575333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9a5abc9a-9ea8-4ce3-b874-664e234ae178 None None] MFA Rules not processed for user `98adb3810b7a401fb37d73354430500a`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:47.576582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9a5abc9a-9ea8-4ce3-b874-664e234ae178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:47.656490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1083/2165] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:47.667259 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360a41a-a582-4721-9602-bbf183a7082d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:47.669187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4360a41a-a582-4721-9602-bbf183a7082d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:47.743719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360a41a-a582-4721-9602-bbf183a7082d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:47.748763 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991344-793e-4bfa-ad38-52a01ac12c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:47.749923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991344-793e-4bfa-ad38-52a01ac12c1e service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:47.750475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991344-793e-4bfa-ad38-52a01ac12c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:47.751356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991344-793e-4bfa-ad38-52a01ac12c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:47.761852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991344-793e-4bfa-ad38-52a01ac12c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:47.763315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991344-793e-4bfa-ad38-52a01ac12c1e service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:47.776463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1083/2166] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:48.355594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5abc9a-9ea8-4ce3-b874-664e234ae178 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:48.419724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5abc9a-9ea8-4ce3-b874-664e234ae178 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:48.424908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:48.425777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:48.426058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:48.426328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] PATH_INFO: `/v3/users/bd322bf8a9004f259337fe7e91efec14` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:48.427535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd322bf8a9004f259337fe7e91efec14)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:48.429450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:48.475854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd322bf8a9004f259337fe7e91efec14'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:48.476498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd322bf8a9004f259337fe7e91efec14'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:48.483608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd322bf8a9004f259337fe7e91efec14'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:48.484229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd322bf8a9004f259337fe7e91efec14'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:48.496025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd322bf8a9004f259337fe7e91efec14'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:48.509922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1084/2167] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:48 2022] DELETE /identity/v3/users/bd322bf8a9004f259337fe7e91efec14 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:48.514535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111ee0-0883-4254-a317-78ece1180b6d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:48.515529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111ee0-0883-4254-a317-78ece1180b6d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:48.515919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111ee0-0883-4254-a317-78ece1180b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:48.540733 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ee111ee0-0883-4254-a317-78ece1180b6d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:48.541912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ee111ee0-0883-4254-a317-78ece1180b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:48.553499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:48.606818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1084/2168] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:48.619265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:48.622019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:48.629089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:48.684352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16053e13-cc59-44d3-9950-17f66fe3da82 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:48.688578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86b384-386f-4ed5-b0d6-2e58fbf0ac52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:48.689218 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86b384-386f-4ed5-b0d6-2e58fbf0ac52 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:48.689504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86b384-386f-4ed5-b0d6-2e58fbf0ac52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:48.689779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86b384-386f-4ed5-b0d6-2e58fbf0ac52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:48.698730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86b384-386f-4ed5-b0d6-2e58fbf0ac52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:48.700169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86b384-386f-4ed5-b0d6-2e58fbf0ac52 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:48.710266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1085/2169] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:48.971613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee111ee0-0883-4254-a317-78ece1180b6d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:48.973092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ee111ee0-0883-4254-a317-78ece1180b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:48.985096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee111ee0-0883-4254-a317-78ece1180b6d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:48.992855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:48.993715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:48.994128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:48.994305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] PATH_INFO: `/v3/projects/1d9193f4feb14b0a8e562eeaec2457ff` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:48.996030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9193f4feb14b0a8e562eeaec2457ff)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:48.998291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:49.050388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9193f4feb14b0a8e562eeaec2457ff', 'request_id': 'req-8fd49132-76eb-4103-aba3-c94ba41218e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.058103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9193f4feb14b0a8e562eeaec2457ff', 'request_id': 'req-8fd49132-76eb-4103-aba3-c94ba41218e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.065196 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9193f4feb14b0a8e562eeaec2457ff', 'request_id': 'req-8fd49132-76eb-4103-aba3-c94ba41218e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.076313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] The token cache is being invalidate because project 1d9193f4feb14b0a8e562eeaec2457ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:49.076671 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.078203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.079853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1085/2170] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:48 2022] DELETE /identity/v3/projects/1d9193f4feb14b0a8e562eeaec2457ff => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:49.083790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86b384-386f-4ed5-b0d6-2e58fbf0ac52 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:49.093719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86b384-386f-4ed5-b0d6-2e58fbf0ac52 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:49.152830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:49.153784 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:49.154177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:49.154513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] PATH_INFO: `/v3/users/98adb3810b7a401fb37d73354430500a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:49.156008 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98adb3810b7a401fb37d73354430500a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:49.159299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:49.206676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98adb3810b7a401fb37d73354430500a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.207355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98adb3810b7a401fb37d73354430500a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.214105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98adb3810b7a401fb37d73354430500a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.214756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98adb3810b7a401fb37d73354430500a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.226328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d6d036f9-b5ab-4726-878e-8fd976d5ad6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98adb3810b7a401fb37d73354430500a'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.239012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1086/2171] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:49 2022] DELETE /identity/v3/users/98adb3810b7a401fb37d73354430500a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:49.537646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:49.539556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:49.559809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd49132-76eb-4103-aba3-c94ba41218e5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:49.637451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:49.639018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:49.639366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:49.639917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] PATH_INFO: `/v3/projects/264ab8db85e34f6386daf029090ee29c` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:49.641477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=264ab8db85e34f6386daf029090ee29c)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:49.650955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:49.689557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:49.697418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264ab8db85e34f6386daf029090ee29c', 'request_id': 'req-205b76d0-b1f3-452c-9d77-d0097cc34520'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.708142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264ab8db85e34f6386daf029090ee29c', 'request_id': 'req-205b76d0-b1f3-452c-9d77-d0097cc34520'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.714837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264ab8db85e34f6386daf029090ee29c', 'request_id': 'req-205b76d0-b1f3-452c-9d77-d0097cc34520'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.725283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] The token cache is being invalidate because project 264ab8db85e34f6386daf029090ee29c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:49.725566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.726199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-205b76d0-b1f3-452c-9d77-d0097cc34520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:49.727750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1086/2172] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:49 2022] DELETE /identity/v3/projects/264ab8db85e34f6386daf029090ee29c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:49.732634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8521b2b-f108-4673-901d-976f433dcf36 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:49.733128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8521b2b-f108-4673-901d-976f433dcf36 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:49.733221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8521b2b-f108-4673-901d-976f433dcf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:49.751807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b8521b2b-f108-4673-901d-976f433dcf36 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:49.753005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b8521b2b-f108-4673-901d-976f433dcf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:49.772070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:49.815898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1087/2173] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:49.823703 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820eb88-3983-4fb9-b878-a50b80255f08 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:49.823993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820eb88-3983-4fb9-b878-a50b80255f08 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:49.824301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820eb88-3983-4fb9-b878-a50b80255f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:49.843663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4820eb88-3983-4fb9-b878-a50b80255f08 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:49.844863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4820eb88-3983-4fb9-b878-a50b80255f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:49.852826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1087/2174] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:49.856998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8521b2b-f108-4673-901d-976f433dcf36 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:49.867367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8521b2b-f108-4673-901d-976f433dcf36 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:49.871905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197806f9-21ff-4008-82fe-e4012fb09fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:49.872552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197806f9-21ff-4008-82fe-e4012fb09fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:49.872838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197806f9-21ff-4008-82fe-e4012fb09fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:49.873115 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197806f9-21ff-4008-82fe-e4012fb09fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:49.873841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197806f9-21ff-4008-82fe-e4012fb09fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:49.874211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197806f9-21ff-4008-82fe-e4012fb09fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:49.875829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197806f9-21ff-4008-82fe-e4012fb09fcc admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:49.887526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1088/2175] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:09:49.892036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820eb88-3983-4fb9-b878-a50b80255f08 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:49.901084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820eb88-3983-4fb9-b878-a50b80255f08 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:49.906634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599102e-e66b-4347-aaa5-c22d0b98c1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:49.907308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599102e-e66b-4347-aaa5-c22d0b98c1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:49.907586 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599102e-e66b-4347-aaa5-c22d0b98c1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:49.907858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599102e-e66b-4347-aaa5-c22d0b98c1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:49.908537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599102e-e66b-4347-aaa5-c22d0b98c1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:49.910408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599102e-e66b-4347-aaa5-c22d0b98c1b2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:49.937376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1088/2176] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:49 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:49.951703 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197806f9-21ff-4008-82fe-e4012fb09fcc admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:49.962438 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197806f9-21ff-4008-82fe-e4012fb09fcc admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:50.020858 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5d4c-7262-436b-a1f1-e8d5f085bbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:50.021586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5d4c-7262-436b-a1f1-e8d5f085bbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:50.021885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5d4c-7262-436b-a1f1-e8d5f085bbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:50.022196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5d4c-7262-436b-a1f1-e8d5f085bbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:50.022982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5d4c-7262-436b-a1f1-e8d5f085bbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:50.024887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5d4c-7262-436b-a1f1-e8d5f085bbd3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:50.045025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1089/2177] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:49 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:09:50.049349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599102e-e66b-4347-aaa5-c22d0b98c1b2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:50.059496 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599102e-e66b-4347-aaa5-c22d0b98c1b2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:50.064304 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eeb9e-52a7-4f22-9ba3-a9bedf6f46b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:50.064954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eeb9e-52a7-4f22-9ba3-a9bedf6f46b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:50.065234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eeb9e-52a7-4f22-9ba3-a9bedf6f46b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:50.065507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eeb9e-52a7-4f22-9ba3-a9bedf6f46b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:50.066220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9eeb9e-52a7-4f22-9ba3-a9bedf6f46b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:50.067858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9eeb9e-52a7-4f22-9ba3-a9bedf6f46b9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:50.078921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1089/2178] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:50.082910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5d4c-7262-436b-a1f1-e8d5f085bbd3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:50.093841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5d4c-7262-436b-a1f1-e8d5f085bbd3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:50.098230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f45a0-2aa3-4f36-9cac-a7c3bad363e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:50.098916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f45a0-2aa3-4f36-9cac-a7c3bad363e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:50.099198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f45a0-2aa3-4f36-9cac-a7c3bad363e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:50.099468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f45a0-2aa3-4f36-9cac-a7c3bad363e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:50.100190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f45a0-2aa3-4f36-9cac-a7c3bad363e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:50.101775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f45a0-2aa3-4f36-9cac-a7c3bad363e6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:50.111749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1090/2179] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:09:50.115730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eeb9e-52a7-4f22-9ba3-a9bedf6f46b9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:50.125592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eeb9e-52a7-4f22-9ba3-a9bedf6f46b9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:50.130163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6442879-15a5-42b4-8f4d-8dd72e96c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:50.131075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6442879-15a5-42b4-8f4d-8dd72e96c1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:50.131360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6442879-15a5-42b4-8f4d-8dd72e96c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:50.131640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6442879-15a5-42b4-8f4d-8dd72e96c1f4 admin admin] PATH_INFO: `/v3/projects/27c4badcdf7949cbaa560fcfd73f2fc0/users/208b62472b7a435d95955957038e2892/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:50.146811 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6442879-15a5-42b4-8f4d-8dd72e96c1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c4badcdf7949cbaa560fcfd73f2fc0, user_id=208b62472b7a435d95955957038e2892, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:50.149465 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6442879-15a5-42b4-8f4d-8dd72e96c1f4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:50.163147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1090/2180] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:50 2022] PUT /identity/v3/projects/27c4badcdf7949cbaa560fcfd73f2fc0/users/208b62472b7a435d95955957038e2892/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:50.173922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200de40c-7442-4380-975b-a2dca3527e0c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:50.174217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200de40c-7442-4380-975b-a2dca3527e0c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:50.174497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200de40c-7442-4380-975b-a2dca3527e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:50.200679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-200de40c-7442-4380-975b-a2dca3527e0c None None] MFA Rules not processed for user `208b62472b7a435d95955957038e2892`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:50.201878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-200de40c-7442-4380-975b-a2dca3527e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:50.272283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1091/2181] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:50.285208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6442879-15a5-42b4-8f4d-8dd72e96c1f4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:50.287098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c6442879-15a5-42b4-8f4d-8dd72e96c1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:50.350886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6442879-15a5-42b4-8f4d-8dd72e96c1f4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:50.354454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3c135-a9f5-4104-b56d-8998dbd6adab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:50.355140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c135-a9f5-4104-b56d-8998dbd6adab service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:50.355406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c135-a9f5-4104-b56d-8998dbd6adab service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:50.355681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c135-a9f5-4104-b56d-8998dbd6adab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:50.364573 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3c135-a9f5-4104-b56d-8998dbd6adab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:50.365949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3c135-a9f5-4104-b56d-8998dbd6adab service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:50.376393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1091/2182] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:56.537893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200de40c-7442-4380-975b-a2dca3527e0c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:56.539314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-200de40c-7442-4380-975b-a2dca3527e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:56.561286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:56.604472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200de40c-7442-4380-975b-a2dca3527e0c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:56.609792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:56.610653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:56.611025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:56.611299 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] PATH_INFO: `/v3/users/45f8798b1437441aa059236a21bdfd59` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:56.612468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f8798b1437441aa059236a21bdfd59)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:56.614379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:56.659364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f8798b1437441aa059236a21bdfd59'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:56.659994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f8798b1437441aa059236a21bdfd59'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:56.666683 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f8798b1437441aa059236a21bdfd59'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:56.667319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f8798b1437441aa059236a21bdfd59'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:56.679749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f8798b1437441aa059236a21bdfd59'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:56.692879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1092/2183] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:09:56 2022] DELETE /identity/v3/users/45f8798b1437441aa059236a21bdfd59 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:56.697218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2457bda-c47f-4f2e-963d-127bdc8a14cc None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:56.697712 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2457bda-c47f-4f2e-963d-127bdc8a14cc None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:56.697804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2457bda-c47f-4f2e-963d-127bdc8a14cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:56.715059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c2457bda-c47f-4f2e-963d-127bdc8a14cc None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:56.716257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c2457bda-c47f-4f2e-963d-127bdc8a14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:56.776398 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1092/2184] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:56.786577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:56.787998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:56.847445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1055e08-f415-4004-b1f2-b1d536352d3f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:56.851087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ae067-51a7-4053-b533-841f8873e6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:56.851730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ae067-51a7-4053-b533-841f8873e6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:56.852043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ae067-51a7-4053-b533-841f8873e6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:56.852322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ae067-51a7-4053-b533-841f8873e6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:56.861252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ae067-51a7-4053-b533-841f8873e6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:56.862676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ae067-51a7-4053-b533-841f8873e6f0 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:56.872057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1093/2185] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:57.130846 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2457bda-c47f-4f2e-963d-127bdc8a14cc None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:57.132520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c2457bda-c47f-4f2e-963d-127bdc8a14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:57.145266 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2457bda-c47f-4f2e-963d-127bdc8a14cc None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:57.151147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:57.151975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.152154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.152430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] PATH_INFO: `/v3/projects/4e53b5c27ff1492cba01bdb3ba6a60dc` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.153757 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e53b5c27ff1492cba01bdb3ba6a60dc)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:57.155977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:57.158907 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:57.207167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e53b5c27ff1492cba01bdb3ba6a60dc', 'request_id': 'req-84cccaa6-5957-40a1-98be-a81439ae8784'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:57.214744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e53b5c27ff1492cba01bdb3ba6a60dc', 'request_id': 'req-84cccaa6-5957-40a1-98be-a81439ae8784'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:57.221985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e53b5c27ff1492cba01bdb3ba6a60dc', 'request_id': 'req-84cccaa6-5957-40a1-98be-a81439ae8784'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:57.234237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] The token cache is being invalidate because project 4e53b5c27ff1492cba01bdb3ba6a60dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:09:57.234530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:57.235267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-84cccaa6-5957-40a1-98be-a81439ae8784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:09:57.236836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1093/2186] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:09:57 2022] DELETE /identity/v3/projects/4e53b5c27ff1492cba01bdb3ba6a60dc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:57.241668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9724f-a8de-4bea-8e38-f49f81b3bc54 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.241962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9724f-a8de-4bea-8e38-f49f81b3bc54 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.242242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9724f-a8de-4bea-8e38-f49f81b3bc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.272644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-15e9724f-a8de-4bea-8e38-f49f81b3bc54 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:57.273849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-15e9724f-a8de-4bea-8e38-f49f81b3bc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:57.308694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:57.346389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1094/2187] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:57.354019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a586-f35a-4586-bcbd-b13e83920e99 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.354296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a586-f35a-4586-bcbd-b13e83920e99 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.354574 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a586-f35a-4586-bcbd-b13e83920e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.375684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4e69a586-f35a-4586-bcbd-b13e83920e99 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:57.376899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4e69a586-f35a-4586-bcbd-b13e83920e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:57.385694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1094/2188] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:57.390028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9724f-a8de-4bea-8e38-f49f81b3bc54 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:57.399658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9724f-a8de-4bea-8e38-f49f81b3bc54 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:57.404225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b0fab-5441-4476-b29a-6c29e8b49e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:57.405464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b0fab-5441-4476-b29a-6c29e8b49e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.405800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b0fab-5441-4476-b29a-6c29e8b49e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.406077 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b0fab-5441-4476-b29a-6c29e8b49e73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.406828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b0fab-5441-4476-b29a-6c29e8b49e73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:09:57.407137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b0fab-5441-4476-b29a-6c29e8b49e73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:57.408734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b0fab-5441-4476-b29a-6c29e8b49e73 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:57.420146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1095/2189] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:09:57.425326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a586-f35a-4586-bcbd-b13e83920e99 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:57.435041 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a586-f35a-4586-bcbd-b13e83920e99 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:57.439985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c62acc-160b-4ae2-b8ef-3ec9390fa3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:57.440625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c62acc-160b-4ae2-b8ef-3ec9390fa3de admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.440902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c62acc-160b-4ae2-b8ef-3ec9390fa3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.441171 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c62acc-160b-4ae2-b8ef-3ec9390fa3de admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.441848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c62acc-160b-4ae2-b8ef-3ec9390fa3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:57.443838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c62acc-160b-4ae2-b8ef-3ec9390fa3de admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:57.469640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1095/2190] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:57 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:57.473778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b0fab-5441-4476-b29a-6c29e8b49e73 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:57.483864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b0fab-5441-4476-b29a-6c29e8b49e73 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:57.540640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224f6ba-1df7-42a4-9188-d5b8f755b240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:57.541307 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224f6ba-1df7-42a4-9188-d5b8f755b240 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.541593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224f6ba-1df7-42a4-9188-d5b8f755b240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.541863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224f6ba-1df7-42a4-9188-d5b8f755b240 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.542552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224f6ba-1df7-42a4-9188-d5b8f755b240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:57.544487 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224f6ba-1df7-42a4-9188-d5b8f755b240 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:57.563942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1096/2191] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:57 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:57.567911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c62acc-160b-4ae2-b8ef-3ec9390fa3de admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:57.578911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c62acc-160b-4ae2-b8ef-3ec9390fa3de admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:57.583772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93118e-bf88-4ccf-b32a-5813d9c875ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:57.584538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93118e-bf88-4ccf-b32a-5813d9c875ae admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.584824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93118e-bf88-4ccf-b32a-5813d9c875ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.585098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93118e-bf88-4ccf-b32a-5813d9c875ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.585809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93118e-bf88-4ccf-b32a-5813d9c875ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:57.587458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93118e-bf88-4ccf-b32a-5813d9c875ae admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:57.598513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1096/2192] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:57.602374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224f6ba-1df7-42a4-9188-d5b8f755b240 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:57.612479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224f6ba-1df7-42a4-9188-d5b8f755b240 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:57.616991 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d86c6-7319-4aef-8324-b48ae7c95427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:57.617650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d86c6-7319-4aef-8324-b48ae7c95427 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.617934 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d86c6-7319-4aef-8324-b48ae7c95427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.618211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d86c6-7319-4aef-8324-b48ae7c95427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.618969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d86c6-7319-4aef-8324-b48ae7c95427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:57.620554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d86c6-7319-4aef-8324-b48ae7c95427 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:57.630349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1097/2193] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:57.634459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93118e-bf88-4ccf-b32a-5813d9c875ae admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:57.644945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93118e-bf88-4ccf-b32a-5813d9c875ae admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:57.649401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470a800-ed89-4592-b7c8-310a298959f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:57.650259 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470a800-ed89-4592-b7c8-310a298959f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.650537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470a800-ed89-4592-b7c8-310a298959f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.650836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470a800-ed89-4592-b7c8-310a298959f8 admin admin] PATH_INFO: `/v3/projects/d6028b5395954c1c9523979ae33f0777/users/f75089913cca440bab9747b6d970e17c/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.669267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470a800-ed89-4592-b7c8-310a298959f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6028b5395954c1c9523979ae33f0777, user_id=f75089913cca440bab9747b6d970e17c, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:57.674569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470a800-ed89-4592-b7c8-310a298959f8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:57.688332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1097/2194] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:57 2022] PUT /identity/v3/projects/d6028b5395954c1c9523979ae33f0777/users/f75089913cca440bab9747b6d970e17c/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:57.703010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d4bd-2144-4b47-a738-e841afb1575c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.703308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d4bd-2144-4b47-a738-e841afb1575c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.703587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d4bd-2144-4b47-a738-e841afb1575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.730045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0860d4bd-2144-4b47-a738-e841afb1575c None None] MFA Rules not processed for user `f75089913cca440bab9747b6d970e17c`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:57.731271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0860d4bd-2144-4b47-a738-e841afb1575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:57.795042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1098/2195] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:57.800288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470a800-ed89-4592-b7c8-310a298959f8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:57.861590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470a800-ed89-4592-b7c8-310a298959f8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:57.866044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b644-d301-4e15-b8e1-9aa3714c4c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:57.866687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b644-d301-4e15-b8e1-9aa3714c4c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.866995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b644-d301-4e15-b8e1-9aa3714c4c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.867275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b644-d301-4e15-b8e1-9aa3714c4c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.867958 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0b644-d301-4e15-b8e1-9aa3714c4c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:57.869876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0b644-d301-4e15-b8e1-9aa3714c4c14 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:57.894876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1098/2196] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:09:57 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:57.898854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860d4bd-2144-4b47-a738-e841afb1575c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:57.911250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860d4bd-2144-4b47-a738-e841afb1575c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:57.940803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:57.974456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6dc37-2e38-47bd-8eb8-8869615ee90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:57.975164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6dc37-2e38-47bd-8eb8-8869615ee90b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:57.975449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6dc37-2e38-47bd-8eb8-8869615ee90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:57.975724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6dc37-2e38-47bd-8eb8-8869615ee90b admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:57.976418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6dc37-2e38-47bd-8eb8-8869615ee90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:57.978333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6dc37-2e38-47bd-8eb8-8869615ee90b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:57.998859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1099/2197] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:09:57 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:09:58.002870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b644-d301-4e15-b8e1-9aa3714c4c14 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:58.013418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b644-d301-4e15-b8e1-9aa3714c4c14 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:58.018085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9a81-b600-47cb-b715-05f87467fe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:58.018839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9a81-b600-47cb-b715-05f87467fe6e admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:58.019134 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9a81-b600-47cb-b715-05f87467fe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:58.019417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9a81-b600-47cb-b715-05f87467fe6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:58.020136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a9a81-b600-47cb-b715-05f87467fe6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:58.021825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a9a81-b600-47cb-b715-05f87467fe6e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:58.032880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1099/2198] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:58.036813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6dc37-2e38-47bd-8eb8-8869615ee90b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:58.047231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6dc37-2e38-47bd-8eb8-8869615ee90b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:58.051839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e79db-c9c8-4466-942a-7348a4da6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:58.052709 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e79db-c9c8-4466-942a-7348a4da6fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:58.052993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e79db-c9c8-4466-942a-7348a4da6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:58.053271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e79db-c9c8-4466-942a-7348a4da6fb8 admin admin] PATH_INFO: `/v3/projects/280ccb7f1f654977bda1ce8dbc5f76af/users/4703bbdac84147528ff5dbc12e1c974f/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:58.068174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e79db-c9c8-4466-942a-7348a4da6fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280ccb7f1f654977bda1ce8dbc5f76af, user_id=4703bbdac84147528ff5dbc12e1c974f, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:58.070863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e79db-c9c8-4466-942a-7348a4da6fb8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:58.084109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1100/2199] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:58 2022] PUT /identity/v3/projects/280ccb7f1f654977bda1ce8dbc5f76af/users/4703bbdac84147528ff5dbc12e1c974f/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:09:58.088129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9a81-b600-47cb-b715-05f87467fe6e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:58.093286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:09:58.099462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9a81-b600-47cb-b715-05f87467fe6e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:58.156452 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3499c-ce20-4439-b109-5798bcc81692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:58.157110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3499c-ce20-4439-b109-5798bcc81692 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:58.157392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3499c-ce20-4439-b109-5798bcc81692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:58.157669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3499c-ce20-4439-b109-5798bcc81692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:58.158388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3499c-ce20-4439-b109-5798bcc81692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:58.160017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3499c-ce20-4439-b109-5798bcc81692 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:58.170326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1100/2200] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:09:58.174037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e79db-c9c8-4466-942a-7348a4da6fb8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:58.184218 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e79db-c9c8-4466-942a-7348a4da6fb8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:58.189339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8869db-8789-4aca-9815-11d76a645795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:58.190217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8869db-8789-4aca-9815-11d76a645795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:58.190499 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8869db-8789-4aca-9815-11d76a645795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:58.190808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8869db-8789-4aca-9815-11d76a645795 admin admin] PATH_INFO: `/v3/projects/280ccb7f1f654977bda1ce8dbc5f76af/users/4703bbdac84147528ff5dbc12e1c974f/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:58.192776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8869db-8789-4aca-9815-11d76a645795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280ccb7f1f654977bda1ce8dbc5f76af, user_id=4703bbdac84147528ff5dbc12e1c974f, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:58.195422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8869db-8789-4aca-9815-11d76a645795 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:58.207137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1101/2201] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:09:58 2022] PUT /identity/v3/projects/280ccb7f1f654977bda1ce8dbc5f76af/users/4703bbdac84147528ff5dbc12e1c974f/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:09:58.218550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a066e2-90b8-4a6a-8293-741ee6fb1f3b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:58.218875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a066e2-90b8-4a6a-8293-741ee6fb1f3b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:58.219162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a066e2-90b8-4a6a-8293-741ee6fb1f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:58.245327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-72a066e2-90b8-4a6a-8293-741ee6fb1f3b None None] MFA Rules not processed for user `4703bbdac84147528ff5dbc12e1c974f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:09:58.246531 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-72a066e2-90b8-4a6a-8293-741ee6fb1f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:58.318544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1101/2202] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:09:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:09:58.329893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8869db-8789-4aca-9815-11d76a645795 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:58.331614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8d8869db-8789-4aca-9815-11d76a645795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:09:58.399324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8869db-8789-4aca-9815-11d76a645795 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:58.403031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be8052-6998-4c0d-927c-2b898a3ba5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:58.403681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8052-6998-4c0d-927c-2b898a3ba5fe service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:58.403971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8052-6998-4c0d-927c-2b898a3ba5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:58.404300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8052-6998-4c0d-927c-2b898a3ba5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:58.414363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be8052-6998-4c0d-927c-2b898a3ba5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:58.415778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be8052-6998-4c0d-927c-2b898a3ba5fe service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:58.425909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1102/2203] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:09:58.502643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a066e2-90b8-4a6a-8293-741ee6fb1f3b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:09:58.513037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a066e2-90b8-4a6a-8293-741ee6fb1f3b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:09:58.517169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dc8b3-5f40-432c-a962-9948db6d354f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:09:58.517824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dc8b3-5f40-432c-a962-9948db6d354f service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:09:58.518206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dc8b3-5f40-432c-a962-9948db6d354f service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:09:58.518491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dc8b3-5f40-432c-a962-9948db6d354f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:09:58.580255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dc8b3-5f40-432c-a962-9948db6d354f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:09:58.581693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dc8b3-5f40-432c-a962-9948db6d354f service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:09:58.590432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1102/2204] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:09:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:03.471852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be8052-6998-4c0d-927c-2b898a3ba5fe service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:03.473379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-91be8052-6998-4c0d-927c-2b898a3ba5fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:03.542343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be8052-6998-4c0d-927c-2b898a3ba5fe service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:03.547898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:03.548885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:03.549160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:03.549434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] PATH_INFO: `/v3/users/208b62472b7a435d95955957038e2892` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:03.550663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208b62472b7a435d95955957038e2892)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:03.552606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:03.590160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:03.614292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208b62472b7a435d95955957038e2892'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:03.615002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208b62472b7a435d95955957038e2892'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:03.622994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208b62472b7a435d95955957038e2892'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:03.624374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208b62472b7a435d95955957038e2892'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:03.638198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208b62472b7a435d95955957038e2892'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:03.651969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1103/2205] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:03 2022] DELETE /identity/v3/users/208b62472b7a435d95955957038e2892 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:03.656735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736e567-37dd-4303-9502-33cf366de8d1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:03.657210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736e567-37dd-4303-9502-33cf366de8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:03.657874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736e567-37dd-4303-9502-33cf366de8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:03.678825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2736e567-37dd-4303-9502-33cf366de8d1 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:03.681796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2736e567-37dd-4303-9502-33cf366de8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:03.708037 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:03.757588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1103/2206] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:03.768074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:03.769486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:03.845272 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11e953-a8a3-44dd-8e03-1617dda950c4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:03.850428 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fa3e-88a7-4d9a-a124-4705b0f9fe1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:03.851322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fa3e-88a7-4d9a-a124-4705b0f9fe1d service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:03.851749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fa3e-88a7-4d9a-a124-4705b0f9fe1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:03.852170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fa3e-88a7-4d9a-a124-4705b0f9fe1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:03.872646 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3fa3e-88a7-4d9a-a124-4705b0f9fe1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:03.875378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3fa3e-88a7-4d9a-a124-4705b0f9fe1d service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:03.887161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1104/2207] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:04.110255 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736e567-37dd-4303-9502-33cf366de8d1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.112064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2736e567-37dd-4303-9502-33cf366de8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:04.133096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736e567-37dd-4303-9502-33cf366de8d1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:04.139618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:04.140253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.140536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.140812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] PATH_INFO: `/v3/users/1110aa5c5d95441db47f0107bbace9fb` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.142058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1110aa5c5d95441db47f0107bbace9fb)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:04.144046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:04.200643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1110aa5c5d95441db47f0107bbace9fb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.208373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1110aa5c5d95441db47f0107bbace9fb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.209441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1110aa5c5d95441db47f0107bbace9fb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.210078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1110aa5c5d95441db47f0107bbace9fb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.211502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fa3e-88a7-4d9a-a124-4705b0f9fe1d service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.213287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b7e3fa3e-88a7-4d9a-a124-4705b0f9fe1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:04.228106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b74e3922-f234-4af3-827d-be409048a581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1110aa5c5d95441db47f0107bbace9fb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.230674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fa3e-88a7-4d9a-a124-4705b0f9fe1d service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:04.239280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:04.240197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.240484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.240751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] PATH_INFO: `/v3/projects/27c4badcdf7949cbaa560fcfd73f2fc0` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.241970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c4badcdf7949cbaa560fcfd73f2fc0)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:04.242628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1104/2208] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:04 2022] DELETE /identity/v3/users/1110aa5c5d95441db47f0107bbace9fb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:04.244073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:04.247214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2451e23-85e7-43a8-9965-474c9a58db71 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.247658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2451e23-85e7-43a8-9965-474c9a58db71 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.248004 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2451e23-85e7-43a8-9965-474c9a58db71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.266918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d2451e23-85e7-43a8-9965-474c9a58db71 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:04.268771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d2451e23-85e7-43a8-9965-474c9a58db71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:04.296325 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c4badcdf7949cbaa560fcfd73f2fc0', 'request_id': 'req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.306412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c4badcdf7949cbaa560fcfd73f2fc0', 'request_id': 'req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.313408 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c4badcdf7949cbaa560fcfd73f2fc0', 'request_id': 'req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.325174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] The token cache is being invalidate because project 27c4badcdf7949cbaa560fcfd73f2fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:04.325503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.326200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7cbecd9e-18b7-4eb4-8182-946fa759ac7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.328923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1105/2209] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:04 2022] DELETE /identity/v3/projects/27c4badcdf7949cbaa560fcfd73f2fc0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:04.333430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699a4ea-f230-4971-91b0-fb84efe21a09 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.333711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699a4ea-f230-4971-91b0-fb84efe21a09 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.333985 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699a4ea-f230-4971-91b0-fb84efe21a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.337662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1105/2210] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:04.348725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2451e23-85e7-43a8-9965-474c9a58db71 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.350076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d2451e23-85e7-43a8-9965-474c9a58db71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:04.352192 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0699a4ea-f230-4971-91b0-fb84efe21a09 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:04.353353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0699a4ea-f230-4971-91b0-fb84efe21a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:04.380627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:04.396915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:04.416544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2451e23-85e7-43a8-9965-474c9a58db71 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:04.418541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1106/2211] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:04.427093 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6093e10-2498-4410-9f74-90b056a0e3cc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.427379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6093e10-2498-4410-9f74-90b056a0e3cc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.427651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6093e10-2498-4410-9f74-90b056a0e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.446177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b6093e10-2498-4410-9f74-90b056a0e3cc None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:04.447396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b6093e10-2498-4410-9f74-90b056a0e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:04.455533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1107/2212] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:04.459493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6093e10-2498-4410-9f74-90b056a0e3cc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.466693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe67f7-aca8-43b6-a52a-2442ac655e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:04.467421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe67f7-aca8-43b6-a52a-2442ac655e46 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.467701 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe67f7-aca8-43b6-a52a-2442ac655e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.468158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe67f7-aca8-43b6-a52a-2442ac655e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.468529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6093e10-2498-4410-9f74-90b056a0e3cc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:04.473082 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd114be-1bb7-49c6-89e4-4cc121d5fecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:04.473747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd114be-1bb7-49c6-89e4-4cc121d5fecc admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.474193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd114be-1bb7-49c6-89e4-4cc121d5fecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.474468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd114be-1bb7-49c6-89e4-4cc121d5fecc admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.476540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd114be-1bb7-49c6-89e4-4cc121d5fecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:10:04.476540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd114be-1bb7-49c6-89e4-4cc121d5fecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:04.477441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe67f7-aca8-43b6-a52a-2442ac655e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:04.478900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe67f7-aca8-43b6-a52a-2442ac655e46 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:04.480002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd114be-1bb7-49c6-89e4-4cc121d5fecc admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:04.489468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1106/2213] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:04.495915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1108/2214] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:10:04.501210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe67f7-aca8-43b6-a52a-2442ac655e46 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.511104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe67f7-aca8-43b6-a52a-2442ac655e46 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:04.515932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d80c4b-8b1c-40ed-aeef-bd913021cae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:04.516594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80c4b-8b1c-40ed-aeef-bd913021cae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.516881 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80c4b-8b1c-40ed-aeef-bd913021cae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.517160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80c4b-8b1c-40ed-aeef-bd913021cae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.517866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d80c4b-8b1c-40ed-aeef-bd913021cae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:04.519837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d80c4b-8b1c-40ed-aeef-bd913021cae9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:04.549187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1107/2215] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:04 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:04.553261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd114be-1bb7-49c6-89e4-4cc121d5fecc admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.564473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd114be-1bb7-49c6-89e4-4cc121d5fecc admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:04.622725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dad23-3a72-4ce7-85ee-15bf888ba78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:04.623640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dad23-3a72-4ce7-85ee-15bf888ba78e admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.623940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dad23-3a72-4ce7-85ee-15bf888ba78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.624237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dad23-3a72-4ce7-85ee-15bf888ba78e admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.625087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dad23-3a72-4ce7-85ee-15bf888ba78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:04.627156 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dad23-3a72-4ce7-85ee-15bf888ba78e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:04.658336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1109/2216] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:04 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:04.662523 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d80c4b-8b1c-40ed-aeef-bd913021cae9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.673768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d80c4b-8b1c-40ed-aeef-bd913021cae9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:04.678505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764c0e5-6100-46c9-aeb1-68f10aa6a9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:04.679271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764c0e5-6100-46c9-aeb1-68f10aa6a9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.679726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764c0e5-6100-46c9-aeb1-68f10aa6a9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.680072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764c0e5-6100-46c9-aeb1-68f10aa6a9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.680864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764c0e5-6100-46c9-aeb1-68f10aa6a9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:04.682520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764c0e5-6100-46c9-aeb1-68f10aa6a9fb admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:04.693501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1108/2217] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:04.697450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dad23-3a72-4ce7-85ee-15bf888ba78e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.707840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dad23-3a72-4ce7-85ee-15bf888ba78e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:04.712544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb083d27-41d0-4a45-978c-c7f5c9652c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:04.713287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb083d27-41d0-4a45-978c-c7f5c9652c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.713630 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb083d27-41d0-4a45-978c-c7f5c9652c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.713979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb083d27-41d0-4a45-978c-c7f5c9652c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.714813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb083d27-41d0-4a45-978c-c7f5c9652c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:04.716495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb083d27-41d0-4a45-978c-c7f5c9652c1a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:04.727370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1110/2218] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:04.731248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764c0e5-6100-46c9-aeb1-68f10aa6a9fb admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.742497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764c0e5-6100-46c9-aeb1-68f10aa6a9fb admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:04.747605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756c1d2-d284-4b8a-abcd-a9d4d3485368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:04.748684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756c1d2-d284-4b8a-abcd-a9d4d3485368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.748963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756c1d2-d284-4b8a-abcd-a9d4d3485368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.749247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756c1d2-d284-4b8a-abcd-a9d4d3485368 admin admin] PATH_INFO: `/v3/projects/4e1e9c8dddf741f9b0267313bd150717/users/21ec180e6c0c4e58aa178ebf4a6b475c/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.762996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb083d27-41d0-4a45-978c-c7f5c9652c1a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.764975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bb083d27-41d0-4a45-978c-c7f5c9652c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:04.765713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756c1d2-d284-4b8a-abcd-a9d4d3485368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1e9c8dddf741f9b0267313bd150717, user_id=21ec180e6c0c4e58aa178ebf4a6b475c, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:04.768911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756c1d2-d284-4b8a-abcd-a9d4d3485368 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:04.779061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb083d27-41d0-4a45-978c-c7f5c9652c1a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:04.785595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1109/2219] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:04 2022] PUT /identity/v3/projects/4e1e9c8dddf741f9b0267313bd150717/users/21ec180e6c0c4e58aa178ebf4a6b475c/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:04.796014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25709db-e0c2-4087-9728-8bcb6a273a7e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.796968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25709db-e0c2-4087-9728-8bcb6a273a7e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.797141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25709db-e0c2-4087-9728-8bcb6a273a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.827139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a25709db-e0c2-4087-9728-8bcb6a273a7e None None] MFA Rules not processed for user `21ec180e6c0c4e58aa178ebf4a6b475c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:04.828396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a25709db-e0c2-4087-9728-8bcb6a273a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:04.848059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:04.848922 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:04.849207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:04.849484 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] PATH_INFO: `/v3/projects/7672fb79123a485d9420b33bb6dca6af` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:04.850674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7672fb79123a485d9420b33bb6dca6af)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:04.852619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:04.888543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:04.895654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1110/2220] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:04.904417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7672fb79123a485d9420b33bb6dca6af', 'request_id': 'req-6c69663c-a43c-410e-92bd-24792ac1ca79'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.909420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25709db-e0c2-4087-9728-8bcb6a273a7e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.910957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a25709db-e0c2-4087-9728-8bcb6a273a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:04.913244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7672fb79123a485d9420b33bb6dca6af', 'request_id': 'req-6c69663c-a43c-410e-92bd-24792ac1ca79'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.919006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7672fb79123a485d9420b33bb6dca6af', 'request_id': 'req-6c69663c-a43c-410e-92bd-24792ac1ca79'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.931287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] The token cache is being invalidate because project 7672fb79123a485d9420b33bb6dca6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:04.931573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.932241 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:04.934057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1111/2221] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:04 2022] DELETE /identity/v3/projects/7672fb79123a485d9420b33bb6dca6af => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:04.937929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:04.939281 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:04.942146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:04.971167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25709db-e0c2-4087-9728-8bcb6a273a7e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:05.003452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69663c-a43c-410e-92bd-24792ac1ca79 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:05.008932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:05.009838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:05.010123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:05.010402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] PATH_INFO: `/v3/users/74125bbf7755447a8f8f729ca802a907` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:05.011687 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74125bbf7755447a8f8f729ca802a907)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:05.013606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:05.020336 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420730a9-3e31-4e7f-8b77-3fe27cb98187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:05.021054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420730a9-3e31-4e7f-8b77-3fe27cb98187 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:05.021404 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420730a9-3e31-4e7f-8b77-3fe27cb98187 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:05.021744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420730a9-3e31-4e7f-8b77-3fe27cb98187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:05.023626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-420730a9-3e31-4e7f-8b77-3fe27cb98187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:05.066658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74125bbf7755447a8f8f729ca802a907'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.067392 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74125bbf7755447a8f8f729ca802a907'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.074264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74125bbf7755447a8f8f729ca802a907'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.074961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74125bbf7755447a8f8f729ca802a907'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.087324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74125bbf7755447a8f8f729ca802a907'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.090827 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420730a9-3e31-4e7f-8b77-3fe27cb98187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:05.098922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420730a9-3e31-4e7f-8b77-3fe27cb98187 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:05.105502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1112/2222] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:04 2022] DELETE /identity/v3/users/74125bbf7755447a8f8f729ca802a907 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:05.110872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1111/2223] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:05.146993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:05.148885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:05.211261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:05.240745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4528cee-a602-4d80-bc04-14dd2cce66b8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:05.245848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:05.246755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:05.247045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:05.247324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] PATH_INFO: `/v3/users/21ec180e6c0c4e58aa178ebf4a6b475c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:05.248582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ec180e6c0c4e58aa178ebf4a6b475c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:05.250503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:05.306873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ec180e6c0c4e58aa178ebf4a6b475c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.307577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ec180e6c0c4e58aa178ebf4a6b475c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.315152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ec180e6c0c4e58aa178ebf4a6b475c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.315817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ec180e6c0c4e58aa178ebf4a6b475c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.328963 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ec180e6c0c4e58aa178ebf4a6b475c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.350454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1113/2224] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:05 2022] DELETE /identity/v3/users/21ec180e6c0c4e58aa178ebf4a6b475c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:05.355167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecb576-c6d4-4a07-9875-ce4f11e7f4bb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:05.355463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecb576-c6d4-4a07-9875-ce4f11e7f4bb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:05.355762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecb576-c6d4-4a07-9875-ce4f11e7f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:05.374370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-31ecb576-c6d4-4a07-9875-ce4f11e7f4bb None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:05.375736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-31ecb576-c6d4-4a07-9875-ce4f11e7f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:05.437506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:05.440684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:05.448284 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1112/2225] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:05.459255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10279af-7ede-4b02-abe4-b54885baea75 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:05.459927 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecb576-c6d4-4a07-9875-ce4f11e7f4bb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:05.461278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-31ecb576-c6d4-4a07-9875-ce4f11e7f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:05.464345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:05.464892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:05.465180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:05.465451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] PATH_INFO: `/v3/projects/c29ea7781a544589b1dba7cf357e3809` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:05.466632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29ea7781a544589b1dba7cf357e3809)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:05.469174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:05.523983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29ea7781a544589b1dba7cf357e3809', 'request_id': 'req-b72c3079-9c19-449e-ac65-5786319e4c4c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.527339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:05.533718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29ea7781a544589b1dba7cf357e3809', 'request_id': 'req-b72c3079-9c19-449e-ac65-5786319e4c4c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.542679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29ea7781a544589b1dba7cf357e3809', 'request_id': 'req-b72c3079-9c19-449e-ac65-5786319e4c4c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.545628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecb576-c6d4-4a07-9875-ce4f11e7f4bb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:05.554565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] The token cache is being invalidate because project c29ea7781a544589b1dba7cf357e3809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:05.554881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.555554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.557321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1114/2226] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:05 2022] DELETE /identity/v3/projects/c29ea7781a544589b1dba7cf357e3809 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:05.563569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:05.565350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:05.596554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792551c-6278-4d80-ae60-37e7d174f29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:05.597194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792551c-6278-4d80-ae60-37e7d174f29e service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:05.597480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792551c-6278-4d80-ae60-37e7d174f29e service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:05.597786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792551c-6278-4d80-ae60-37e7d174f29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:05.599644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d792551c-6278-4d80-ae60-37e7d174f29e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:05.609065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:05.635809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c3079-9c19-449e-ac65-5786319e4c4c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:05.641230 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:05.642097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:05.642381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:05.642652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] PATH_INFO: `/v3/users/1a259cf289fc476f94a937d8189f9b97` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:05.643863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a259cf289fc476f94a937d8189f9b97)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:05.645771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:05.666900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792551c-6278-4d80-ae60-37e7d174f29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:05.668381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792551c-6278-4d80-ae60-37e7d174f29e service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:05.679273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1113/2227] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:05.696259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a259cf289fc476f94a937d8189f9b97'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.696964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a259cf289fc476f94a937d8189f9b97'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.707184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a259cf289fc476f94a937d8189f9b97'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.708130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a259cf289fc476f94a937d8189f9b97'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.721314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a259cf289fc476f94a937d8189f9b97'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:05.739089 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1115/2228] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:05 2022] DELETE /identity/v3/users/1a259cf289fc476f94a937d8189f9b97 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:06.283816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792551c-6278-4d80-ae60-37e7d174f29e service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.285263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d792551c-6278-4d80-ae60-37e7d174f29e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:06.307713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.309354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:06.312272 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792551c-6278-4d80-ae60-37e7d174f29e service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.385706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.386580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.386899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.387181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] PATH_INFO: `/v3/projects/4e1e9c8dddf741f9b0267313bd150717` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.388398 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1e9c8dddf741f9b0267313bd150717)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.390454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.398081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d58a6-a86c-4535-a2d4-572ae48620e9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.403513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.404919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.405210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.405492 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] PATH_INFO: `/v3/projects/310e7cbd312540cdb741a5b2bd59c3c6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.406715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310e7cbd312540cdb741a5b2bd59c3c6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.408673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.440304 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:06.446180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1e9c8dddf741f9b0267313bd150717', 'request_id': 'req-9f9f7093-109f-4a6e-a9af-412da1ae5242'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:06.468135 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1e9c8dddf741f9b0267313bd150717', 'request_id': 'req-9f9f7093-109f-4a6e-a9af-412da1ae5242'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:06.479856 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1e9c8dddf741f9b0267313bd150717', 'request_id': 'req-9f9f7093-109f-4a6e-a9af-412da1ae5242'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:06.496344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] The token cache is being invalidate because project 4e1e9c8dddf741f9b0267313bd150717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:06.496588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310e7cbd312540cdb741a5b2bd59c3c6', 'request_id': 'req-e7b8c1a6-594a-4ca9-8c94-010821802350'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:06.496795 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:06.497451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9f9f7093-109f-4a6e-a9af-412da1ae5242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:06.500009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1114/2229] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:06 2022] DELETE /identity/v3/projects/4e1e9c8dddf741f9b0267313bd150717 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:06.504907 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc405ef-501b-492d-b056-ab93a0a752b0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.505390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc405ef-501b-492d-b056-ab93a0a752b0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.505863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc405ef-501b-492d-b056-ab93a0a752b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.513433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310e7cbd312540cdb741a5b2bd59c3c6', 'request_id': 'req-e7b8c1a6-594a-4ca9-8c94-010821802350'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:06.523694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310e7cbd312540cdb741a5b2bd59c3c6', 'request_id': 'req-e7b8c1a6-594a-4ca9-8c94-010821802350'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:06.525196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:06.530267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9bc405ef-501b-492d-b056-ab93a0a752b0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:06.531809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9bc405ef-501b-492d-b056-ab93a0a752b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:06.539624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] The token cache is being invalidate because project 310e7cbd312540cdb741a5b2bd59c3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:06.542210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:06.543897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-e7b8c1a6-594a-4ca9-8c94-010821802350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:06.546176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1116/2230] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:06 2022] DELETE /identity/v3/projects/310e7cbd312540cdb741a5b2bd59c3c6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:06.551264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948207d0-6930-4dfa-9b89-476c432a5c9d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.551568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948207d0-6930-4dfa-9b89-476c432a5c9d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.551852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948207d0-6930-4dfa-9b89-476c432a5c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.572192 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-948207d0-6930-4dfa-9b89-476c432a5c9d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:06.573480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-948207d0-6930-4dfa-9b89-476c432a5c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:06.602665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1115/2231] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:06.611170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf61f3c-c5a4-4579-a747-23f06f40d7a5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.611457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf61f3c-c5a4-4579-a747-23f06f40d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.611735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf61f3c-c5a4-4579-a747-23f06f40d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.629964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-faf61f3c-c5a4-4579-a747-23f06f40d7a5 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:06.631198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-faf61f3c-c5a4-4579-a747-23f06f40d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:06.634139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1117/2232] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:06.639892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1116/2233] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:06.642293 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74432-42d1-49e7-98e9-124733ce3158 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.642587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74432-42d1-49e7-98e9-124733ce3158 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.643146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc74432-42d1-49e7-98e9-124733ce3158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.643719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf61f3c-c5a4-4579-a747-23f06f40d7a5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.653544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf61f3c-c5a4-4579-a747-23f06f40d7a5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.659501 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbde483-eb19-4480-9375-2b417c848646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.660143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbde483-eb19-4480-9375-2b417c848646 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.660432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbde483-eb19-4480-9375-2b417c848646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.660709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbde483-eb19-4480-9375-2b417c848646 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.661440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbde483-eb19-4480-9375-2b417c848646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:10:06.661747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbde483-eb19-4480-9375-2b417c848646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.662393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7bc74432-42d1-49e7-98e9-124733ce3158 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:06.663409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbde483-eb19-4480-9375-2b417c848646 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.663599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7bc74432-42d1-49e7-98e9-124733ce3158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:06.671507 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1118/2234] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:06.675543 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1117/2235] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:10:06.676052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74432-42d1-49e7-98e9-124733ce3158 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.679651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbde483-eb19-4480-9375-2b417c848646 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.684338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc74432-42d1-49e7-98e9-124733ce3158 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.689032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c49a6-a835-484f-a4eb-7ba73b0d8e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.689315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbde483-eb19-4480-9375-2b417c848646 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.689667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c49a6-a835-484f-a4eb-7ba73b0d8e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.689950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c49a6-a835-484f-a4eb-7ba73b0d8e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.690225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c49a6-a835-484f-a4eb-7ba73b0d8e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.690972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c49a6-a835-484f-a4eb-7ba73b0d8e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:10:06.691283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c49a6-a835-484f-a4eb-7ba73b0d8e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.692848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c49a6-a835-484f-a4eb-7ba73b0d8e1e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.694062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a23b52-2d33-46b7-bfb2-07586fcc6612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.694685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a23b52-2d33-46b7-bfb2-07586fcc6612 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.694991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a23b52-2d33-46b7-bfb2-07586fcc6612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.695269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a23b52-2d33-46b7-bfb2-07586fcc6612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.695946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a23b52-2d33-46b7-bfb2-07586fcc6612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.697814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a23b52-2d33-46b7-bfb2-07586fcc6612 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.705519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1119/2236] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:10:06.709652 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c49a6-a835-484f-a4eb-7ba73b0d8e1e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.719995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c49a6-a835-484f-a4eb-7ba73b0d8e1e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.724600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa044d-7676-420b-b82f-cdabd4131497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.725267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa044d-7676-420b-b82f-cdabd4131497 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.725549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa044d-7676-420b-b82f-cdabd4131497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.725823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa044d-7676-420b-b82f-cdabd4131497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.729500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1118/2237] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:06 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:10:06.729634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa044d-7676-420b-b82f-cdabd4131497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.729634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa044d-7676-420b-b82f-cdabd4131497 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.730454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a23b52-2d33-46b7-bfb2-07586fcc6612 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.758783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1120/2238] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:06 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:10:06.762885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa044d-7676-420b-b82f-cdabd4131497 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.798249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a23b52-2d33-46b7-bfb2-07586fcc6612 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.825046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa044d-7676-420b-b82f-cdabd4131497 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.830358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70365a6-25b1-4316-acfc-0ea62ac1e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.831056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70365a6-25b1-4316-acfc-0ea62ac1e32a admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.831345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70365a6-25b1-4316-acfc-0ea62ac1e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.831624 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70365a6-25b1-4316-acfc-0ea62ac1e32a admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.832310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70365a6-25b1-4316-acfc-0ea62ac1e32a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.834345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70365a6-25b1-4316-acfc-0ea62ac1e32a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.837449 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:06.855234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1121/2239] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:06 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:10:06.859152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70365a6-25b1-4316-acfc-0ea62ac1e32a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.861083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f045226-5adc-4a88-a3d6-9999ccc18b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.861753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045226-5adc-4a88-a3d6-9999ccc18b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.862155 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045226-5adc-4a88-a3d6-9999ccc18b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.862439 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045226-5adc-4a88-a3d6-9999ccc18b83 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.863278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f045226-5adc-4a88-a3d6-9999ccc18b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.865193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f045226-5adc-4a88-a3d6-9999ccc18b83 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.868640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70365a6-25b1-4316-acfc-0ea62ac1e32a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.873885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3594b8-c7d2-4e0c-8b2c-ed6cc69e2147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.874537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3594b8-c7d2-4e0c-8b2c-ed6cc69e2147 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.874868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3594b8-c7d2-4e0c-8b2c-ed6cc69e2147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.875147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3594b8-c7d2-4e0c-8b2c-ed6cc69e2147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.875865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3594b8-c7d2-4e0c-8b2c-ed6cc69e2147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.877673 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3594b8-c7d2-4e0c-8b2c-ed6cc69e2147 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.887107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1119/2240] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:06 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:10:06.890732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1122/2241] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:10:06.891709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f045226-5adc-4a88-a3d6-9999ccc18b83 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.893168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3594b8-c7d2-4e0c-8b2c-ed6cc69e2147 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.901657 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f045226-5adc-4a88-a3d6-9999ccc18b83 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.902926 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3594b8-c7d2-4e0c-8b2c-ed6cc69e2147 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.906590 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004951-9305-47a7-ae5c-1b923e91bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.907276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004951-9305-47a7-ae5c-1b923e91bb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.907563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004951-9305-47a7-ae5c-1b923e91bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.907838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004951-9305-47a7-ae5c-1b923e91bb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.908027 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09138976-ab77-489d-8098-7451d9670f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.908563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004951-9305-47a7-ae5c-1b923e91bb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.908664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138976-ab77-489d-8098-7451d9670f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.908940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138976-ab77-489d-8098-7451d9670f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.909220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138976-ab77-489d-8098-7451d9670f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.909928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09138976-ab77-489d-8098-7451d9670f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.910151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004951-9305-47a7-ae5c-1b923e91bb9a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.911526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09138976-ab77-489d-8098-7451d9670f8a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.920486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1120/2242] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:10:06.925244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1123/2243] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:10:06.926030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09138976-ab77-489d-8098-7451d9670f8a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.926276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004951-9305-47a7-ae5c-1b923e91bb9a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.936569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09138976-ab77-489d-8098-7451d9670f8a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.936933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004951-9305-47a7-ae5c-1b923e91bb9a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.941364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46b1bb-4a96-4364-962a-f6e901249ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.941546 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595cab7-d106-4977-a3da-3b9a162a2fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:06.942174 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595cab7-d106-4977-a3da-3b9a162a2fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.942282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46b1bb-4a96-4364-962a-f6e901249ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.942456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595cab7-d106-4977-a3da-3b9a162a2fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.942551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46b1bb-4a96-4364-962a-f6e901249ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.942762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595cab7-d106-4977-a3da-3b9a162a2fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.942889 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46b1bb-4a96-4364-962a-f6e901249ab6 admin admin] PATH_INFO: `/v3/projects/99bc86fccaff473aaa2ee8b35c7a357f/users/06b8d18d37e7467f84841ec6ac0080fb/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:06.943594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595cab7-d106-4977-a3da-3b9a162a2fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.945246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595cab7-d106-4977-a3da-3b9a162a2fe5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.955269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:06.959295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46b1bb-4a96-4364-962a-f6e901249ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99bc86fccaff473aaa2ee8b35c7a357f, user_id=06b8d18d37e7467f84841ec6ac0080fb, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:06.959470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1121/2244] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:10:06.960309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595cab7-d106-4977-a3da-3b9a162a2fe5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:06.963123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46b1bb-4a96-4364-962a-f6e901249ab6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:06.972100 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595cab7-d106-4977-a3da-3b9a162a2fe5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:06.977658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1124/2245] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:06 2022] PUT /identity/v3/projects/99bc86fccaff473aaa2ee8b35c7a357f/users/06b8d18d37e7467f84841ec6ac0080fb/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:06.982263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eca83-a4e7-412d-a779-b19018a4b681 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:06.982556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eca83-a4e7-412d-a779-b19018a4b681 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:06.983457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eca83-a4e7-412d-a779-b19018a4b681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:07.000115 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-661eca83-a4e7-412d-a779-b19018a4b681 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:07.001323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-661eca83-a4e7-412d-a779-b19018a4b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:07.030175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8195cd2-0f2e-4920-996a-9bd9bd5af160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:07.031167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8195cd2-0f2e-4920-996a-9bd9bd5af160 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:07.031360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8195cd2-0f2e-4920-996a-9bd9bd5af160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:07.031633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8195cd2-0f2e-4920-996a-9bd9bd5af160 admin admin] PATH_INFO: `/v3/projects/eefd7a6998d24e0189ed1c54dc911737/users/3bc1f574f2e84b47ad12c67641cc087c/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:07.047068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8195cd2-0f2e-4920-996a-9bd9bd5af160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefd7a6998d24e0189ed1c54dc911737, user_id=3bc1f574f2e84b47ad12c67641cc087c, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:07.050105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8195cd2-0f2e-4920-996a-9bd9bd5af160 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:07.061222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1125/2246] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:07.064392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1122/2247] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:06 2022] PUT /identity/v3/projects/eefd7a6998d24e0189ed1c54dc911737/users/3bc1f574f2e84b47ad12c67641cc087c/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:07.068302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a49bd-34e7-4d3c-9031-cd6d2e2ef471 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:07.068623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a49bd-34e7-4d3c-9031-cd6d2e2ef471 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:07.068871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a49bd-34e7-4d3c-9031-cd6d2e2ef471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:07.070499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8195cd2-0f2e-4920-996a-9bd9bd5af160 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:07.072280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e8195cd2-0f2e-4920-996a-9bd9bd5af160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:07.087414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-753a49bd-34e7-4d3c-9031-cd6d2e2ef471 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:07.088610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-753a49bd-34e7-4d3c-9031-cd6d2e2ef471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:07.139645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8195cd2-0f2e-4920-996a-9bd9bd5af160 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:07.143356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca7a18-1984-4c2a-a65e-f0c0f1519264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:07.143995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca7a18-1984-4c2a-a65e-f0c0f1519264 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:07.144274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca7a18-1984-4c2a-a65e-f0c0f1519264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:07.144546 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca7a18-1984-4c2a-a65e-f0c0f1519264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:07.153476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1126/2248] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:07.163675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a49bd-34e7-4d3c-9031-cd6d2e2ef471 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:07.165057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-753a49bd-34e7-4d3c-9031-cd6d2e2ef471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:07.177696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a49bd-34e7-4d3c-9031-cd6d2e2ef471 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:07.181349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beec4a-66f4-4e49-8757-49daaeb4de2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:07.181985 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beec4a-66f4-4e49-8757-49daaeb4de2b service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:07.182268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beec4a-66f4-4e49-8757-49daaeb4de2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:07.182545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beec4a-66f4-4e49-8757-49daaeb4de2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:07.190490 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:07.191681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beec4a-66f4-4e49-8757-49daaeb4de2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:07.193120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beec4a-66f4-4e49-8757-49daaeb4de2b service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:07.203957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1127/2249] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:07.208140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca7a18-1984-4c2a-a65e-f0c0f1519264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:07.209706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca7a18-1984-4c2a-a65e-f0c0f1519264 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:07.221045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1123/2250] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:08.175055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb7558-00d8-47a6-a0f8-3c47930489fc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:08.175598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb7558-00d8-47a6-a0f8-3c47930489fc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:08.175704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb7558-00d8-47a6-a0f8-3c47930489fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:08.208602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f7eb7558-00d8-47a6-a0f8-3c47930489fc None None] MFA Rules not processed for user `3bc1f574f2e84b47ad12c67641cc087c`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:08.210098 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f7eb7558-00d8-47a6-a0f8-3c47930489fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:08.334637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1128/2251] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:08.351840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca7a18-1984-4c2a-a65e-f0c0f1519264 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:08.353328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8bca7a18-1984-4c2a-a65e-f0c0f1519264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:08.442676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca7a18-1984-4c2a-a65e-f0c0f1519264 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:08.448602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885d7f8-ed53-4da5-ac5c-6bfe18e87848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:08.449472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d7f8-ed53-4da5-ac5c-6bfe18e87848 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:08.449947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d7f8-ed53-4da5-ac5c-6bfe18e87848 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:08.450404 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d7f8-ed53-4da5-ac5c-6bfe18e87848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:08.461303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885d7f8-ed53-4da5-ac5c-6bfe18e87848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:08.463787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885d7f8-ed53-4da5-ac5c-6bfe18e87848 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:08.475660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1124/2252] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:10.034559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48a74c-9e58-4ffb-b65b-4b1bad9c5ae5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:10.035428 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48a74c-9e58-4ffb-b65b-4b1bad9c5ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:10.035884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48a74c-9e58-4ffb-b65b-4b1bad9c5ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:10.066647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4a48a74c-9e58-4ffb-b65b-4b1bad9c5ae5 None None] MFA Rules not processed for user `3bc1f574f2e84b47ad12c67641cc087c`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:10.075373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4a48a74c-9e58-4ffb-b65b-4b1bad9c5ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:10.093037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1129/2253] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:11.660369 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885d7f8-ed53-4da5-ac5c-6bfe18e87848 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:11.662157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4885d7f8-ed53-4da5-ac5c-6bfe18e87848 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:11.692890 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885d7f8-ed53-4da5-ac5c-6bfe18e87848 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:11.706752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:11.707571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:11.708071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:11.709355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] PATH_INFO: `/v3/users/54c65a1967814a6bbb34f116dadb4180` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:11.712567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c65a1967814a6bbb34f116dadb4180)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:11.719555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:11.835385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c65a1967814a6bbb34f116dadb4180'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:11.844686 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c65a1967814a6bbb34f116dadb4180'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:11.845419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c65a1967814a6bbb34f116dadb4180'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:11.846102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c65a1967814a6bbb34f116dadb4180'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:11.875220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c65a1967814a6bbb34f116dadb4180'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:11.896360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1125/2254] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:11 2022] DELETE /identity/v3/users/54c65a1967814a6bbb34f116dadb4180 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:11.900580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb517a1-09b2-4bf2-9670-f520e496cbd3 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:11.901041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb517a1-09b2-4bf2-9670-f520e496cbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:11.901287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb517a1-09b2-4bf2-9670-f520e496cbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:11.910848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:11.950068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8fb517a1-09b2-4bf2-9670-f520e496cbd3 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:11.953197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8fb517a1-09b2-4bf2-9670-f520e496cbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:12.161033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1130/2255] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:12.171021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:12.172555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:12.336781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b0aef-67ae-46b6-8353-232016c57edf admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:12.352635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a8962-a4af-4cb3-9be7-7f7c8cfe3727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:12.353399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8962-a4af-4cb3-9be7-7f7c8cfe3727 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:12.353684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8962-a4af-4cb3-9be7-7f7c8cfe3727 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:12.353955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8962-a4af-4cb3-9be7-7f7c8cfe3727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:12.368620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a8962-a4af-4cb3-9be7-7f7c8cfe3727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:12.370339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a8962-a4af-4cb3-9be7-7f7c8cfe3727 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:12.379596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:12.393552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1126/2256] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:12.971268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb517a1-09b2-4bf2-9670-f520e496cbd3 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:12.973253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8fb517a1-09b2-4bf2-9670-f520e496cbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:12.996237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb517a1-09b2-4bf2-9670-f520e496cbd3 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:13.010256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:13.011791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.012338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.012738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] PATH_INFO: `/v3/projects/8a04e0b3165e4edfba2e2c4d04aa8ed6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.015166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a04e0b3165e4edfba2e2c4d04aa8ed6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:13.018887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:13.088498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a04e0b3165e4edfba2e2c4d04aa8ed6', 'request_id': 'req-bb18ea1b-f9c5-4175-baf9-27ea526856dd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:13.102614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a04e0b3165e4edfba2e2c4d04aa8ed6', 'request_id': 'req-bb18ea1b-f9c5-4175-baf9-27ea526856dd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:13.116088 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a04e0b3165e4edfba2e2c4d04aa8ed6', 'request_id': 'req-bb18ea1b-f9c5-4175-baf9-27ea526856dd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:13.149618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] The token cache is being invalidate because project 8a04e0b3165e4edfba2e2c4d04aa8ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:13.149920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:13.150576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bb18ea1b-f9c5-4175-baf9-27ea526856dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:13.152401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1131/2257] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:12 2022] DELETE /identity/v3/projects/8a04e0b3165e4edfba2e2c4d04aa8ed6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:13.158364 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405888-4984-4e45-b43a-6192e7fd4b6a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.158968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405888-4984-4e45-b43a-6192e7fd4b6a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.159072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405888-4984-4e45-b43a-6192e7fd4b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.201818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-98405888-4984-4e45-b43a-6192e7fd4b6a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:13.203300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-98405888-4984-4e45-b43a-6192e7fd4b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:13.323611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1127/2258] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:13.325000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc2331-6c7d-4bf8-9116-88fa8dfa84f2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.325632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc2331-6c7d-4bf8-9116-88fa8dfa84f2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.326151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc2331-6c7d-4bf8-9116-88fa8dfa84f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.337799 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98405888-4984-4e45-b43a-6192e7fd4b6a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:13.340480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-98405888-4984-4e45-b43a-6192e7fd4b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:13.369644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98405888-4984-4e45-b43a-6192e7fd4b6a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:13.382314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a2fc2331-6c7d-4bf8-9116-88fa8dfa84f2 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:13.384225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a2fc2331-6c7d-4bf8-9116-88fa8dfa84f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:13.391432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:13.392464 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.392764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.393043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] PATH_INFO: `/v3/users/f75089913cca440bab9747b6d970e17c` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.394869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75089913cca440bab9747b6d970e17c)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:13.396825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:13.398354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1132/2259] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:13.403762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc2331-6c7d-4bf8-9116-88fa8dfa84f2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:13.414045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc2331-6c7d-4bf8-9116-88fa8dfa84f2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:13.421599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b34bca-3241-4aac-8e12-af5cb213e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:13.422396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b34bca-3241-4aac-8e12-af5cb213e429 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.422822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b34bca-3241-4aac-8e12-af5cb213e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.423774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b34bca-3241-4aac-8e12-af5cb213e429 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.426035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b34bca-3241-4aac-8e12-af5cb213e429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:10:13.426035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b34bca-3241-4aac-8e12-af5cb213e429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:13.427788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b34bca-3241-4aac-8e12-af5cb213e429 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:13.450236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1133/2260] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:10:13.455151 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b34bca-3241-4aac-8e12-af5cb213e429 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:13.467312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75089913cca440bab9747b6d970e17c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:13.475468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b34bca-3241-4aac-8e12-af5cb213e429 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:13.483815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75089913cca440bab9747b6d970e17c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:13.484715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eae5e8-6037-4531-9012-5955057c3cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:13.484868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75089913cca440bab9747b6d970e17c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:13.484960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eae5e8-6037-4531-9012-5955057c3cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.485246 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eae5e8-6037-4531-9012-5955057c3cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.485368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75089913cca440bab9747b6d970e17c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:13.485544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eae5e8-6037-4531-9012-5955057c3cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.487059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eae5e8-6037-4531-9012-5955057c3cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:13.489069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eae5e8-6037-4531-9012-5955057c3cd6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:13.502012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-90693701-0557-4bc3-9313-a67d5be64ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75089913cca440bab9747b6d970e17c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:13.534049 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1134/2261] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:13 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:10:13.539132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1128/2262] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:13 2022] DELETE /identity/v3/users/f75089913cca440bab9747b6d970e17c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:13.539932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eae5e8-6037-4531-9012-5955057c3cd6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:13.540786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170bc94-3526-48f8-92e0-c2e9c315b6aa None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.541081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170bc94-3526-48f8-92e0-c2e9c315b6aa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.541363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170bc94-3526-48f8-92e0-c2e9c315b6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.542218 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d1eae5e8-6037-4531-9012-5955057c3cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:13.562446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8170bc94-3526-48f8-92e0-c2e9c315b6aa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:13.563818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8170bc94-3526-48f8-92e0-c2e9c315b6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:13.609990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:13.646595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eae5e8-6037-4531-9012-5955057c3cd6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:13.669349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1129/2263] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:13.685208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170bc94-3526-48f8-92e0-c2e9c315b6aa None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:13.687392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8170bc94-3526-48f8-92e0-c2e9c315b6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:13.714068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:13.728231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb09c9-118e-4597-ad3e-b96a3cdd6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:13.728935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb09c9-118e-4597-ad3e-b96a3cdd6ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.729284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb09c9-118e-4597-ad3e-b96a3cdd6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.729646 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb09c9-118e-4597-ad3e-b96a3cdd6ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.730676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb09c9-118e-4597-ad3e-b96a3cdd6ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:13.735830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb09c9-118e-4597-ad3e-b96a3cdd6ed6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:13.771280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1135/2264] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:13 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:13.774977 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb09c9-118e-4597-ad3e-b96a3cdd6ed6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:13.788048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb09c9-118e-4597-ad3e-b96a3cdd6ed6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:13.790631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170bc94-3526-48f8-92e0-c2e9c315b6aa None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:13.796807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36562e-bb7b-4f8d-959f-a851bc62c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:13.797128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35466092-9b20-4d47-88b5-6f29670f206e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:13.797729 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466092-9b20-4d47-88b5-6f29670f206e service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.798019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466092-9b20-4d47-88b5-6f29670f206e service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.798298 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466092-9b20-4d47-88b5-6f29670f206e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.799510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36562e-bb7b-4f8d-959f-a851bc62c000 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.799987 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36562e-bb7b-4f8d-959f-a851bc62c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.800425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36562e-bb7b-4f8d-959f-a851bc62c000 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.801485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36562e-bb7b-4f8d-959f-a851bc62c000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:13.804407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36562e-bb7b-4f8d-959f-a851bc62c000 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:13.818073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1136/2265] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:10:13.822134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36562e-bb7b-4f8d-959f-a851bc62c000 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:13.822936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35466092-9b20-4d47-88b5-6f29670f206e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:13.825510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35466092-9b20-4d47-88b5-6f29670f206e service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:13.839727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36562e-bb7b-4f8d-959f-a851bc62c000 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:13.845101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1130/2266] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:13.848725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e19e17-61d6-42b3-84bc-e69d9e022983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:13.849651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e19e17-61d6-42b3-84bc-e69d9e022983 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.850031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e19e17-61d6-42b3-84bc-e69d9e022983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.850486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e19e17-61d6-42b3-84bc-e69d9e022983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.851337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e19e17-61d6-42b3-84bc-e69d9e022983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:13.854393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e19e17-61d6-42b3-84bc-e69d9e022983 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:13.870579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1137/2267] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:10:13.875347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35466092-9b20-4d47-88b5-6f29670f206e service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:13.901871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35466092-9b20-4d47-88b5-6f29670f206e service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:13.908668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dd370-f9a8-46b1-8db2-bddc5125174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:13.910812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dd370-f9a8-46b1-8db2-bddc5125174d admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.911176 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dd370-f9a8-46b1-8db2-bddc5125174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.911530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dd370-f9a8-46b1-8db2-bddc5125174d admin admin] PATH_INFO: `/v3/projects/f7e38224b6a74df8b5e931ccda46d3fd/users/b04754683c9d4f9492f474fa30bea1c2/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.932109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd385b3-2d1c-4359-876f-e7266fbbea25 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.932416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd385b3-2d1c-4359-876f-e7266fbbea25 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.932697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd385b3-2d1c-4359-876f-e7266fbbea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.940863 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dd370-f9a8-46b1-8db2-bddc5125174d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e38224b6a74df8b5e931ccda46d3fd, user_id=b04754683c9d4f9492f474fa30bea1c2, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:13.943873 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dd370-f9a8-46b1-8db2-bddc5125174d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:13.968650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1131/2268] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:13 2022] PUT /identity/v3/projects/f7e38224b6a74df8b5e931ccda46d3fd/users/b04754683c9d4f9492f474fa30bea1c2/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:13.970332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e241eb-0aca-493d-8243-abd24e44c212 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:13.970815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e241eb-0aca-493d-8243-abd24e44c212 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:13.971109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e241eb-0aca-493d-8243-abd24e44c212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:13.977365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0cd385b3-2d1c-4359-876f-e7266fbbea25 None None] MFA Rules not processed for user `06b8d18d37e7467f84841ec6ac0080fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:13.979761 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0cd385b3-2d1c-4359-876f-e7266fbbea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:13.993821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-02e241eb-0aca-493d-8243-abd24e44c212 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:13.995449 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-02e241eb-0aca-493d-8243-abd24e44c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:14.082399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1138/2269] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:14.086348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd385b3-2d1c-4359-876f-e7266fbbea25 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:14.087969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0cd385b3-2d1c-4359-876f-e7266fbbea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:14.088757 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1132/2270] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:14.111077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e241eb-0aca-493d-8243-abd24e44c212 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:14.112205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd385b3-2d1c-4359-876f-e7266fbbea25 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:14.124440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4c8af-cf06-4bd2-80da-2b96214aa932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:14.125227 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4c8af-cf06-4bd2-80da-2b96214aa932 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:14.125355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4c8af-cf06-4bd2-80da-2b96214aa932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:14.125631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4c8af-cf06-4bd2-80da-2b96214aa932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:14.126326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4c8af-cf06-4bd2-80da-2b96214aa932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:14.128289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4c8af-cf06-4bd2-80da-2b96214aa932 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:14.180227 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1139/2271] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:14 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:10:14.185376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4c8af-cf06-4bd2-80da-2b96214aa932 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:14.216121 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e241eb-0aca-493d-8243-abd24e44c212 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:14.233388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:14.277848 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:14.283455 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4c8af-cf06-4bd2-80da-2b96214aa932 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:14.286569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac05de-651e-4262-a66a-6dab34e0e703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:14.287444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac05de-651e-4262-a66a-6dab34e0e703 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:14.288045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac05de-651e-4262-a66a-6dab34e0e703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:14.288466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac05de-651e-4262-a66a-6dab34e0e703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:14.293995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a84711-cd47-4926-b464-4d4997992fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:14.295701 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a84711-cd47-4926-b464-4d4997992fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:14.296007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a84711-cd47-4926-b464-4d4997992fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:14.296369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a84711-cd47-4926-b464-4d4997992fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:14.297170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a84711-cd47-4926-b464-4d4997992fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:14.299482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a84711-cd47-4926-b464-4d4997992fe7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:14.308022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac05de-651e-4262-a66a-6dab34e0e703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:14.309619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac05de-651e-4262-a66a-6dab34e0e703 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:14.323079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1133/2272] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:14.340557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1140/2273] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:14 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:14.345902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac05de-651e-4262-a66a-6dab34e0e703 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:14.376785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac05de-651e-4262-a66a-6dab34e0e703 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:14.407521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbfbc6-b144-4721-ad62-527407dfbe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:14.413397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbfbc6-b144-4721-ad62-527407dfbe52 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:14.413862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbfbc6-b144-4721-ad62-527407dfbe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:14.414289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbfbc6-b144-4721-ad62-527407dfbe52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:14.417750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbfbc6-b144-4721-ad62-527407dfbe52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:14.422634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbfbc6-b144-4721-ad62-527407dfbe52 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:14.425609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a84711-cd47-4926-b464-4d4997992fe7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:14.428685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d3a84711-cd47-4926-b464-4d4997992fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:14.445591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a84711-cd47-4926-b464-4d4997992fe7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:14.461094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1134/2274] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:14.462073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbfbc6-b144-4721-ad62-527407dfbe52 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:14.464170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:14.465061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:14.465353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:14.465688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] PATH_INFO: `/v3/projects/d6028b5395954c1c9523979ae33f0777` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:14.467984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6028b5395954c1c9523979ae33f0777)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:14.470172 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:14.484131 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbfbc6-b144-4721-ad62-527407dfbe52 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:14.501413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288222e6-9542-4421-b92c-25f9ce90b469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:14.502427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288222e6-9542-4421-b92c-25f9ce90b469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:14.502771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288222e6-9542-4421-b92c-25f9ce90b469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:14.503209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288222e6-9542-4421-b92c-25f9ce90b469 admin admin] PATH_INFO: `/v3/projects/6d54d0016950455191e6f80880239c42/users/8b3acef01a3b4084917d3aaaa39f4dca/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:14.539351 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288222e6-9542-4421-b92c-25f9ce90b469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d54d0016950455191e6f80880239c42, user_id=8b3acef01a3b4084917d3aaaa39f4dca, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:14.548036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288222e6-9542-4421-b92c-25f9ce90b469 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:14.572120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1135/2275] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:14 2022] PUT /identity/v3/projects/6d54d0016950455191e6f80880239c42/users/8b3acef01a3b4084917d3aaaa39f4dca/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:14.573125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6028b5395954c1c9523979ae33f0777', 'request_id': 'req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:14.577559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288222e6-9542-4421-b92c-25f9ce90b469 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:14.589084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6028b5395954c1c9523979ae33f0777', 'request_id': 'req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:14.600556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6028b5395954c1c9523979ae33f0777', 'request_id': 'req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:14.631927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] The token cache is being invalidate because project d6028b5395954c1c9523979ae33f0777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:14.633345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:14.635169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:14.639895 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1141/2276] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:14 2022] DELETE /identity/v3/projects/d6028b5395954c1c9523979ae33f0777 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:14.644604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:14.647331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:14.693921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288222e6-9542-4421-b92c-25f9ce90b469 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:14.704502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8743550-9f4c-42e2-ac28-06e059d817dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:14.707059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8743550-9f4c-42e2-ac28-06e059d817dc admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:14.707443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8743550-9f4c-42e2-ac28-06e059d817dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:14.710269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8743550-9f4c-42e2-ac28-06e059d817dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:14.711216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8743550-9f4c-42e2-ac28-06e059d817dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:14.713033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8743550-9f4c-42e2-ac28-06e059d817dc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:14.731193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1136/2277] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:14.732840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8743550-9f4c-42e2-ac28-06e059d817dc admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:14.735764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b8743550-9f4c-42e2-ac28-06e059d817dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:14.752743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8743550-9f4c-42e2-ac28-06e059d817dc admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:14.759148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368f74-c751-4131-9bcf-6067a95d137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:14.760122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368f74-c751-4131-9bcf-6067a95d137f admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:14.760543 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368f74-c751-4131-9bcf-6067a95d137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:14.760918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368f74-c751-4131-9bcf-6067a95d137f admin admin] PATH_INFO: `/v3/projects/6d54d0016950455191e6f80880239c42/users/8b3acef01a3b4084917d3aaaa39f4dca/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:14.763299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368f74-c751-4131-9bcf-6067a95d137f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d54d0016950455191e6f80880239c42, user_id=8b3acef01a3b4084917d3aaaa39f4dca, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:14.766494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368f74-c751-4131-9bcf-6067a95d137f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:14.784747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1137/2278] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:14 2022] PUT /identity/v3/projects/6d54d0016950455191e6f80880239c42/users/8b3acef01a3b4084917d3aaaa39f4dca/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:14.812875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35ac6d-2590-494d-8a7b-8f90dfa40a23 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:14.897423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:14.929338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:14.930225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:14.930549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:14.930948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] PATH_INFO: `/v3/users/4703bbdac84147528ff5dbc12e1c974f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:14.936610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4703bbdac84147528ff5dbc12e1c974f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:14.938542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:15.052711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4703bbdac84147528ff5dbc12e1c974f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:15.054450 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4703bbdac84147528ff5dbc12e1c974f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:15.064249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4703bbdac84147528ff5dbc12e1c974f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:15.065211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4703bbdac84147528ff5dbc12e1c974f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:15.087817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-82cbc6e4-9f5d-492f-a3c1-48da58aecd99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4703bbdac84147528ff5dbc12e1c974f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:15.116424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1142/2279] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:14 2022] DELETE /identity/v3/users/4703bbdac84147528ff5dbc12e1c974f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:15.930964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368f74-c751-4131-9bcf-6067a95d137f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:15.933361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-17368f74-c751-4131-9bcf-6067a95d137f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:15.953268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368f74-c751-4131-9bcf-6067a95d137f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:16.042984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:16.042984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:16.042984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:16.042984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] PATH_INFO: `/v3/projects/280ccb7f1f654977bda1ce8dbc5f76af` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:16.044850 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=280ccb7f1f654977bda1ce8dbc5f76af)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:16.051358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:16.166105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:16.183942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280ccb7f1f654977bda1ce8dbc5f76af', 'request_id': 'req-219c503c-802e-41ab-b512-7949569ecb34'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:16.208559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280ccb7f1f654977bda1ce8dbc5f76af', 'request_id': 'req-219c503c-802e-41ab-b512-7949569ecb34'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:16.226273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280ccb7f1f654977bda1ce8dbc5f76af', 'request_id': 'req-219c503c-802e-41ab-b512-7949569ecb34'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:16.248802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] The token cache is being invalidate because project 280ccb7f1f654977bda1ce8dbc5f76af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:16.249099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:16.251230 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-219c503c-802e-41ab-b512-7949569ecb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:16.257747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1138/2280] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:15 2022] DELETE /identity/v3/projects/280ccb7f1f654977bda1ce8dbc5f76af => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:16.259956 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb3cc-652c-4882-ad97-12893dddd9fa None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:16.260947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb3cc-652c-4882-ad97-12893dddd9fa None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:16.261421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb3cc-652c-4882-ad97-12893dddd9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:16.295461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-098fb3cc-652c-4882-ad97-12893dddd9fa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:16.296984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-098fb3cc-652c-4882-ad97-12893dddd9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:16.449204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1143/2281] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:16.458450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b116-6069-4a1f-9ebe-f38ff2814b42 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:16.458766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b116-6069-4a1f-9ebe-f38ff2814b42 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:16.459048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b116-6069-4a1f-9ebe-f38ff2814b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:16.497393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-aff2b116-6069-4a1f-9ebe-f38ff2814b42 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:16.499350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-aff2b116-6069-4a1f-9ebe-f38ff2814b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:16.526338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1139/2282] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:16.527721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fb3cc-652c-4882-ad97-12893dddd9fa None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:16.550038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fb3cc-652c-4882-ad97-12893dddd9fa None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:16.560573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a4bfa-205b-4342-b4c5-c54481dd1f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:16.561629 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a4bfa-205b-4342-b4c5-c54481dd1f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:16.561905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a4bfa-205b-4342-b4c5-c54481dd1f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:16.562179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a4bfa-205b-4342-b4c5-c54481dd1f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:16.563323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a4bfa-205b-4342-b4c5-c54481dd1f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:10:16.563323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a4bfa-205b-4342-b4c5-c54481dd1f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:16.564856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a4bfa-205b-4342-b4c5-c54481dd1f79 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:16.595130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b116-6069-4a1f-9ebe-f38ff2814b42 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:16.610378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b116-6069-4a1f-9ebe-f38ff2814b42 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:16.619333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1144/2283] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:10:16.622543 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556227a-190c-481d-a773-d2de3636fe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:16.624193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556227a-190c-481d-a773-d2de3636fe2e admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:16.624613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556227a-190c-481d-a773-d2de3636fe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:16.624956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556227a-190c-481d-a773-d2de3636fe2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:16.625731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556227a-190c-481d-a773-d2de3636fe2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:16.627755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556227a-190c-481d-a773-d2de3636fe2e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:16.696105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1140/2284] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:16 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:16.696320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a4bfa-205b-4342-b4c5-c54481dd1f79 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:16.713224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a4bfa-205b-4342-b4c5-c54481dd1f79 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:16.828167 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:16.841118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8d105-e8f1-4df8-8b07-58f8bf3cbcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:16.843463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8d105-e8f1-4df8-8b07-58f8bf3cbcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:16.843931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8d105-e8f1-4df8-8b07-58f8bf3cbcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:16.844612 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8d105-e8f1-4df8-8b07-58f8bf3cbcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:16.845483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8d105-e8f1-4df8-8b07-58f8bf3cbcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:16.848086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8d105-e8f1-4df8-8b07-58f8bf3cbcd8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:16.892028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1145/2285] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:16 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:16.895825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556227a-190c-481d-a773-d2de3636fe2e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:16.914596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556227a-190c-481d-a773-d2de3636fe2e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:16.921500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c994e5-9aa8-4158-8540-88bb2622d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:16.922203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c994e5-9aa8-4158-8540-88bb2622d05b admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:16.922489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c994e5-9aa8-4158-8540-88bb2622d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:16.922818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c994e5-9aa8-4158-8540-88bb2622d05b admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:16.923570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c994e5-9aa8-4158-8540-88bb2622d05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:16.925908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c994e5-9aa8-4158-8540-88bb2622d05b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:16.945458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1141/2286] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:16.946409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8d105-e8f1-4df8-8b07-58f8bf3cbcd8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:16.960899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8d105-e8f1-4df8-8b07-58f8bf3cbcd8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:16.966308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babac8cb-76cd-4993-93d3-b67c8aaedd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:16.967323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac8cb-76cd-4993-93d3-b67c8aaedd0f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:16.967689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac8cb-76cd-4993-93d3-b67c8aaedd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:16.967974 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac8cb-76cd-4993-93d3-b67c8aaedd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:16.968717 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babac8cb-76cd-4993-93d3-b67c8aaedd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:16.970791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babac8cb-76cd-4993-93d3-b67c8aaedd0f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:16.984124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1146/2287] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:16.987815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c994e5-9aa8-4158-8540-88bb2622d05b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:17.004269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c994e5-9aa8-4158-8540-88bb2622d05b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:17.009967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de1c99-e4b6-4384-9362-e2cb94ae6c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:17.011150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de1c99-e4b6-4384-9362-e2cb94ae6c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:17.012312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de1c99-e4b6-4384-9362-e2cb94ae6c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:17.013129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de1c99-e4b6-4384-9362-e2cb94ae6c8f admin admin] PATH_INFO: `/v3/projects/5f5b5fdf7fd744249fcb186019c5ba7e/users/f4d2ed49600f434f8c121130aa9502be/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:17.045894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de1c99-e4b6-4384-9362-e2cb94ae6c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5b5fdf7fd744249fcb186019c5ba7e, user_id=f4d2ed49600f434f8c121130aa9502be, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:17.051018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de1c99-e4b6-4384-9362-e2cb94ae6c8f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:17.090845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1142/2288] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:16 2022] PUT /identity/v3/projects/5f5b5fdf7fd744249fcb186019c5ba7e/users/f4d2ed49600f434f8c121130aa9502be/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:17.091181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6103e-953b-469c-bbd8-d84aad75ec4a None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:17.091513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6103e-953b-469c-bbd8-d84aad75ec4a None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:17.092458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6103e-953b-469c-bbd8-d84aad75ec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:17.150793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8bc6103e-953b-469c-bbd8-d84aad75ec4a None None] MFA Rules not processed for user `f4d2ed49600f434f8c121130aa9502be`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:17.154564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8bc6103e-953b-469c-bbd8-d84aad75ec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:17.343395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1147/2289] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:17.344035 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de1c99-e4b6-4384-9362-e2cb94ae6c8f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:17.479867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de1c99-e4b6-4384-9362-e2cb94ae6c8f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:17.485270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faac3f-92f8-482e-836c-ce2808d9121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:17.485862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faac3f-92f8-482e-836c-ce2808d9121e admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:17.486209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faac3f-92f8-482e-836c-ce2808d9121e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:17.486739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faac3f-92f8-482e-836c-ce2808d9121e admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:17.487311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faac3f-92f8-482e-836c-ce2808d9121e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:17.489312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faac3f-92f8-482e-836c-ce2808d9121e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:17.526990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1143/2290] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:17 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:10:17.529391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6103e-953b-469c-bbd8-d84aad75ec4a None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:17.546426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6103e-953b-469c-bbd8-d84aad75ec4a None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:17.632495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ffb5d-4fa0-4aaa-8a4c-f576cd72798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:17.633111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ffb5d-4fa0-4aaa-8a4c-f576cd72798b admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:17.633399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ffb5d-4fa0-4aaa-8a4c-f576cd72798b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:17.633678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ffb5d-4fa0-4aaa-8a4c-f576cd72798b admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:17.634390 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ffb5d-4fa0-4aaa-8a4c-f576cd72798b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:17.636678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ffb5d-4fa0-4aaa-8a4c-f576cd72798b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:17.706418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faac3f-92f8-482e-836c-ce2808d9121e admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:17.721300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faac3f-92f8-482e-836c-ce2808d9121e admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:17.722084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1148/2291] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:17 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:17.735036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d490278-f083-46d5-b75f-4192a372b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:17.737983 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d490278-f083-46d5-b75f-4192a372b0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:17.738300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d490278-f083-46d5-b75f-4192a372b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:17.738598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d490278-f083-46d5-b75f-4192a372b0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:17.739403 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d490278-f083-46d5-b75f-4192a372b0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:17.743615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d490278-f083-46d5-b75f-4192a372b0c3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:17.775898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1144/2292] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:17.780614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ffb5d-4fa0-4aaa-8a4c-f576cd72798b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:17.793426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ffb5d-4fa0-4aaa-8a4c-f576cd72798b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:17.801855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be54790-aa70-4348-86fb-4570c43241c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:17.802962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54790-aa70-4348-86fb-4570c43241c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:17.803254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54790-aa70-4348-86fb-4570c43241c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:17.803546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54790-aa70-4348-86fb-4570c43241c2 admin admin] PATH_INFO: `/v3/projects/386f45dcf16f40ee909dac5a91fd60d2/users/10c0331617984bf09ba13b9d06f573e6/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:17.822094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be54790-aa70-4348-86fb-4570c43241c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386f45dcf16f40ee909dac5a91fd60d2, user_id=10c0331617984bf09ba13b9d06f573e6, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:17.826936 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be54790-aa70-4348-86fb-4570c43241c2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:17.860824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d490278-f083-46d5-b75f-4192a372b0c3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:17.863168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1149/2293] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:17 2022] PUT /identity/v3/projects/386f45dcf16f40ee909dac5a91fd60d2/users/10c0331617984bf09ba13b9d06f573e6/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:17.878018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d490278-f083-46d5-b75f-4192a372b0c3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:17.931253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:17.981953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e111b-8ed8-4b59-8f57-ea039562b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:17.982885 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e111b-8ed8-4b59-8f57-ea039562b308 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:17.983176 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e111b-8ed8-4b59-8f57-ea039562b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:17.983456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e111b-8ed8-4b59-8f57-ea039562b308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:17.984218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e111b-8ed8-4b59-8f57-ea039562b308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:17.986007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e111b-8ed8-4b59-8f57-ea039562b308 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:18.001782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1145/2294] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:18.003150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be54790-aa70-4348-86fb-4570c43241c2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:18.024555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be54790-aa70-4348-86fb-4570c43241c2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:18.031751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bf5ec-5c35-4af6-b294-8d98e712cb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:18.032986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bf5ec-5c35-4af6-b294-8d98e712cb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:18.033437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bf5ec-5c35-4af6-b294-8d98e712cb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:18.034666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bf5ec-5c35-4af6-b294-8d98e712cb69 admin admin] PATH_INFO: `/v3/projects/386f45dcf16f40ee909dac5a91fd60d2/users/10c0331617984bf09ba13b9d06f573e6/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:18.037243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bf5ec-5c35-4af6-b294-8d98e712cb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386f45dcf16f40ee909dac5a91fd60d2, user_id=10c0331617984bf09ba13b9d06f573e6, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:18.042166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bf5ec-5c35-4af6-b294-8d98e712cb69 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:18.064771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1150/2295] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:18 2022] PUT /identity/v3/projects/386f45dcf16f40ee909dac5a91fd60d2/users/10c0331617984bf09ba13b9d06f573e6/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:18.075606 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ad65-81b6-43a6-893d-14678c03eb2b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:18.076677 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ad65-81b6-43a6-893d-14678c03eb2b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:18.077061 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ad65-81b6-43a6-893d-14678c03eb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:18.129314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-97a6ad65-81b6-43a6-893d-14678c03eb2b None None] MFA Rules not processed for user `10c0331617984bf09ba13b9d06f573e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:18.139375 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-97a6ad65-81b6-43a6-893d-14678c03eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:18.261963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1146/2296] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:18.272940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bf5ec-5c35-4af6-b294-8d98e712cb69 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:18.274732 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-622bf5ec-5c35-4af6-b294-8d98e712cb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:18.322298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:18.470865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bf5ec-5c35-4af6-b294-8d98e712cb69 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:18.476958 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4c5c0-3b0d-4579-9879-469b2f5d7fb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:18.478031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4c5c0-3b0d-4579-9879-469b2f5d7fb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:18.478413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4c5c0-3b0d-4579-9879-469b2f5d7fb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:18.478941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4c5c0-3b0d-4579-9879-469b2f5d7fb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:18.549035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4c5c0-3b0d-4579-9879-469b2f5d7fb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:18.550530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4c5c0-3b0d-4579-9879-469b2f5d7fb2 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:18.610123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1151/2297] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:19.429684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6ad65-81b6-43a6-893d-14678c03eb2b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:19.621508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6ad65-81b6-43a6-893d-14678c03eb2b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:19.636201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:19.637083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:19.637370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:19.637651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] PATH_INFO: `/v3/users/f4d2ed49600f434f8c121130aa9502be` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:19.639986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d2ed49600f434f8c121130aa9502be)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:19.642321 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:19.757070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d2ed49600f434f8c121130aa9502be'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:19.780291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d2ed49600f434f8c121130aa9502be'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:19.781354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d2ed49600f434f8c121130aa9502be'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:19.782191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d2ed49600f434f8c121130aa9502be'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:19.795184 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:19.822443 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d2ed49600f434f8c121130aa9502be'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:19.855247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1147/2298] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:19 2022] DELETE /identity/v3/users/f4d2ed49600f434f8c121130aa9502be => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:19.859976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29459327-30de-4b05-ab1c-13dd36750009 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:19.861073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29459327-30de-4b05-ab1c-13dd36750009 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:19.861567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29459327-30de-4b05-ab1c-13dd36750009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:19.886101 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-29459327-30de-4b05-ab1c-13dd36750009 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:19.887869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-29459327-30de-4b05-ab1c-13dd36750009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:20.031094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1152/2299] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:20.140655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:20.142374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:20.325760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7518b28-ce42-47af-9292-6f339d896c4d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:20.337765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7aae0-5e8a-4cd3-9376-f71af2607ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:20.337765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7aae0-5e8a-4cd3-9376-f71af2607ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:20.338055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7aae0-5e8a-4cd3-9376-f71af2607ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:20.340991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7aae0-5e8a-4cd3-9376-f71af2607ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:20.399644 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7aae0-5e8a-4cd3-9376-f71af2607ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:20.402750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7aae0-5e8a-4cd3-9376-f71af2607ce4 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:20.450688 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1148/2300] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:21.063007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29459327-30de-4b05-ab1c-13dd36750009 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:21.066248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-29459327-30de-4b05-ab1c-13dd36750009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:21.108208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29459327-30de-4b05-ab1c-13dd36750009 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:21.131266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:21.133938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:21.135668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:21.136112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] PATH_INFO: `/v3/projects/5f5b5fdf7fd744249fcb186019c5ba7e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:21.143010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5b5fdf7fd744249fcb186019c5ba7e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:21.147825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:21.255849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5b5fdf7fd744249fcb186019c5ba7e', 'request_id': 'req-753ed6c1-078c-4e23-9aaf-b5d312e030ca'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:21.276941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5b5fdf7fd744249fcb186019c5ba7e', 'request_id': 'req-753ed6c1-078c-4e23-9aaf-b5d312e030ca'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:21.291711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5b5fdf7fd744249fcb186019c5ba7e', 'request_id': 'req-753ed6c1-078c-4e23-9aaf-b5d312e030ca'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:21.322792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] The token cache is being invalidate because project 5f5b5fdf7fd744249fcb186019c5ba7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:21.323129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:21.323793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:21.325382 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1153/2301] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:21 2022] DELETE /identity/v3/projects/5f5b5fdf7fd744249fcb186019c5ba7e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:21.331805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7aae0-5e8a-4cd3-9376-f71af2607ce4 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:21.362883 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7aae0-5e8a-4cd3-9376-f71af2607ce4 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:21.494526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:21.498361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:21.499006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:21.499497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] PATH_INFO: `/v3/users/10c0331617984bf09ba13b9d06f573e6` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:21.501306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c0331617984bf09ba13b9d06f573e6)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:21.504059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:21.587903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c0331617984bf09ba13b9d06f573e6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:21.601290 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c0331617984bf09ba13b9d06f573e6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:21.602397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c0331617984bf09ba13b9d06f573e6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:21.603509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c0331617984bf09ba13b9d06f573e6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:21.625679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b61d4945-f5db-4086-853e-d6933e7f33cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c0331617984bf09ba13b9d06f573e6'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:21.639666 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:21.646083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1149/2302] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:21 2022] DELETE /identity/v3/users/10c0331617984bf09ba13b9d06f573e6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:23.266740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:23.268279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:23.291541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ed6c1-078c-4e23-9aaf-b5d312e030ca admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:23.324223 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:23.431051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:23.434669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:23.435818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:23.436310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] PATH_INFO: `/v3/projects/386f45dcf16f40ee909dac5a91fd60d2` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:23.438916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386f45dcf16f40ee909dac5a91fd60d2)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:23.442812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:23.520872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386f45dcf16f40ee909dac5a91fd60d2', 'request_id': 'req-cba157a5-5e53-409c-b1dd-63a6cf17e386'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:23.542598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386f45dcf16f40ee909dac5a91fd60d2', 'request_id': 'req-cba157a5-5e53-409c-b1dd-63a6cf17e386'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:23.550568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a2874-9125-426b-89e5-916dc79fe4e0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:23.551125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a2874-9125-426b-89e5-916dc79fe4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:23.551125 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a2874-9125-426b-89e5-916dc79fe4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:23.554424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386f45dcf16f40ee909dac5a91fd60d2', 'request_id': 'req-cba157a5-5e53-409c-b1dd-63a6cf17e386'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:23.570226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] The token cache is being invalidate because project 386f45dcf16f40ee909dac5a91fd60d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:23.571122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:23.572008 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-cba157a5-5e53-409c-b1dd-63a6cf17e386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:23.578233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1154/2303] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:23 2022] DELETE /identity/v3/projects/386f45dcf16f40ee909dac5a91fd60d2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:23.580534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e987-ae58-490a-818e-2f3e82d4f68f None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:23.581372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e987-ae58-490a-818e-2f3e82d4f68f None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:23.581875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e987-ae58-490a-818e-2f3e82d4f68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:23.594591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-317a2874-9125-426b-89e5-916dc79fe4e0 None None] MFA Rules not processed for user `8b3acef01a3b4084917d3aaaa39f4dca`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:23.596682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-317a2874-9125-426b-89e5-916dc79fe4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:23.606033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-da12e987-ae58-490a-818e-2f3e82d4f68f None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:23.607825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-da12e987-ae58-490a-818e-2f3e82d4f68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:23.700098 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1155/2304] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:23.710400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af59e6-9969-49ff-b6d6-ddcf2a67a43d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:23.712002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af59e6-9969-49ff-b6d6-ddcf2a67a43d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:23.712465 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af59e6-9969-49ff-b6d6-ddcf2a67a43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:23.744942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1150/2305] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:23.745176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c9af59e6-9969-49ff-b6d6-ddcf2a67a43d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:23.746846 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c9af59e6-9969-49ff-b6d6-ddcf2a67a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:23.766057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a2874-9125-426b-89e5-916dc79fe4e0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:23.766211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1156/2306] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:23.767029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af59e6-9969-49ff-b6d6-ddcf2a67a43d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:23.767782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-317a2874-9125-426b-89e5-916dc79fe4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:23.793691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af59e6-9969-49ff-b6d6-ddcf2a67a43d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:23.801028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4393db4-ca70-49db-abff-48cf45203daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:23.803133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393db4-ca70-49db-abff-48cf45203daa admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:23.804727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393db4-ca70-49db-abff-48cf45203daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:23.805024 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393db4-ca70-49db-abff-48cf45203daa admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:23.807080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4393db4-ca70-49db-abff-48cf45203daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:10:23.807587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4393db4-ca70-49db-abff-48cf45203daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:23.809650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4393db4-ca70-49db-abff-48cf45203daa admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:23.849955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1157/2307] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:10:23.850410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4393db4-ca70-49db-abff-48cf45203daa admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:23.876897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4393db4-ca70-49db-abff-48cf45203daa admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:23.892473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b225f1f-dd4a-42b7-9ee2-4f0d12ac591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:23.893152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b225f1f-dd4a-42b7-9ee2-4f0d12ac591e admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:23.893436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b225f1f-dd4a-42b7-9ee2-4f0d12ac591e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:23.893708 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b225f1f-dd4a-42b7-9ee2-4f0d12ac591e admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:23.894596 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b225f1f-dd4a-42b7-9ee2-4f0d12ac591e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:23.897641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b225f1f-dd4a-42b7-9ee2-4f0d12ac591e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:23.906685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a2874-9125-426b-89e5-916dc79fe4e0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:23.913490 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dacd9-ed48-4e86-8aaf-a94530c02c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:23.914310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dacd9-ed48-4e86-8aaf-a94530c02c43 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:23.914714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dacd9-ed48-4e86-8aaf-a94530c02c43 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:23.915115 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dacd9-ed48-4e86-8aaf-a94530c02c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:23.917833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2c9dacd9-ed48-4e86-8aaf-a94530c02c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:23.978363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1158/2308] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:23 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:10:23.979353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b225f1f-dd4a-42b7-9ee2-4f0d12ac591e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:24.002631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:24.033989 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:24.039698 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9dacd9-ed48-4e86-8aaf-a94530c02c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:24.042176 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9dacd9-ed48-4e86-8aaf-a94530c02c43 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:24.059630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1151/2309] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:24.152986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b225f1f-dd4a-42b7-9ee2-4f0d12ac591e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:24.184013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298a404-9524-4fac-b4af-7245369b815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:24.185523 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a404-9524-4fac-b4af-7245369b815e admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:24.189082 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a404-9524-4fac-b4af-7245369b815e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:24.190958 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a404-9524-4fac-b4af-7245369b815e admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:24.193736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298a404-9524-4fac-b4af-7245369b815e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:24.197355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298a404-9524-4fac-b4af-7245369b815e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:24.248568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1159/2310] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:23 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:24.252338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dacd9-ed48-4e86-8aaf-a94530c02c43 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:24.273154 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dacd9-ed48-4e86-8aaf-a94530c02c43 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:24.278814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d97455-5389-4a20-a010-b56f53d7b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:24.279587 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d97455-5389-4a20-a010-b56f53d7b9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:24.279929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d97455-5389-4a20-a010-b56f53d7b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:24.280208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d97455-5389-4a20-a010-b56f53d7b9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:24.280941 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d97455-5389-4a20-a010-b56f53d7b9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:24.282553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d97455-5389-4a20-a010-b56f53d7b9e3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:24.300182 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1152/2311] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:24.301691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298a404-9524-4fac-b4af-7245369b815e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:24.314105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298a404-9524-4fac-b4af-7245369b815e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:24.320498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55a93-df06-4407-94f0-8d2159b07b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:24.321648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55a93-df06-4407-94f0-8d2159b07b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:24.322043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55a93-df06-4407-94f0-8d2159b07b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:24.322462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55a93-df06-4407-94f0-8d2159b07b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:24.323754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa55a93-df06-4407-94f0-8d2159b07b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:24.325305 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa55a93-df06-4407-94f0-8d2159b07b3b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:24.340651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1160/2312] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:24.347177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d97455-5389-4a20-a010-b56f53d7b9e3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:24.365188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d97455-5389-4a20-a010-b56f53d7b9e3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:24.392801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3190d0-8604-43cb-8e6b-380268671310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:24.394037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40be34-3632-490a-bf05-af3bd18d600c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:24.394394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3190d0-8604-43cb-8e6b-380268671310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:24.395464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40be34-3632-490a-bf05-af3bd18d600c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:24.395982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40be34-3632-490a-bf05-af3bd18d600c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:24.402032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3190d0-8604-43cb-8e6b-380268671310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:24.402352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3190d0-8604-43cb-8e6b-380268671310 admin admin] PATH_INFO: `/v3/projects/46cf018dea2a46089c1b6f1a3b28a4c0/users/a840984f51c94ce8b66f98e961a09b25/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:24.452397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3190d0-8604-43cb-8e6b-380268671310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cf018dea2a46089c1b6f1a3b28a4c0, user_id=a840984f51c94ce8b66f98e961a09b25, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:24.466690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3190d0-8604-43cb-8e6b-380268671310 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:24.470825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4b40be34-3632-490a-bf05-af3bd18d600c None None] MFA Rules not processed for user `b04754683c9d4f9492f474fa30bea1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:24.473952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4b40be34-3632-490a-bf05-af3bd18d600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:24.496904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1153/2313] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:24 2022] PUT /identity/v3/projects/46cf018dea2a46089c1b6f1a3b28a4c0/users/a840984f51c94ce8b66f98e961a09b25/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:24.508460 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d4065-905b-426b-85e6-e825ac2e4ac9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:24.508947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d4065-905b-426b-85e6-e825ac2e4ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:24.509234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d4065-905b-426b-85e6-e825ac2e4ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:24.589353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4d9d4065-905b-426b-85e6-e825ac2e4ac9 None None] MFA Rules not processed for user `a840984f51c94ce8b66f98e961a09b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:24.594423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4d9d4065-905b-426b-85e6-e825ac2e4ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:24.655753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1161/2314] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:24.660715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40be34-3632-490a-bf05-af3bd18d600c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:24.662132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4b40be34-3632-490a-bf05-af3bd18d600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:24.692385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40be34-3632-490a-bf05-af3bd18d600c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:24.738920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1154/2315] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:24.743581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d4065-905b-426b-85e6-e825ac2e4ac9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:24.813229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e77ac-45ee-48ad-b28e-458e3f44a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:24.814787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e77ac-45ee-48ad-b28e-458e3f44a834 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:24.816537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e77ac-45ee-48ad-b28e-458e3f44a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:24.816982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e77ac-45ee-48ad-b28e-458e3f44a834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:24.817945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e77ac-45ee-48ad-b28e-458e3f44a834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:24.828082 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e77ac-45ee-48ad-b28e-458e3f44a834 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:24.868915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d4065-905b-426b-85e6-e825ac2e4ac9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:24.884329 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1c204-4771-4a19-9f7e-e631ff06d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:24.887797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1c204-4771-4a19-9f7e-e631ff06d4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:24.888792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1c204-4771-4a19-9f7e-e631ff06d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:24.889362 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1c204-4771-4a19-9f7e-e631ff06d4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:24.891401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1c204-4771-4a19-9f7e-e631ff06d4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:24.892539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1162/2316] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:24 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:24.894629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1c204-4771-4a19-9f7e-e631ff06d4c3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:24.896837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e77ac-45ee-48ad-b28e-458e3f44a834 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:24.904130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:24.958485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1155/2317] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:24 2022] POST /identity/v3/projects => generated 391 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:24.961656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1c204-4771-4a19-9f7e-e631ff06d4c3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:25.093966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:25.096263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e77ac-45ee-48ad-b28e-458e3f44a834 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:25.172566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1c204-4771-4a19-9f7e-e631ff06d4c3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:25.187481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3fd12-e07a-4848-8788-f0688a909cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:25.190609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3fd12-e07a-4848-8788-f0688a909cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:25.192016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3fd12-e07a-4848-8788-f0688a909cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:25.192526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3fd12-e07a-4848-8788-f0688a909cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:25.196014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3fd12-e07a-4848-8788-f0688a909cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:25.196398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902dd5d-47cd-4e92-b6e0-17ad7eff3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:25.197157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902dd5d-47cd-4e92-b6e0-17ad7eff3374 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:25.197515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902dd5d-47cd-4e92-b6e0-17ad7eff3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:25.197860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902dd5d-47cd-4e92-b6e0-17ad7eff3374 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:25.198664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902dd5d-47cd-4e92-b6e0-17ad7eff3374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:25.201583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902dd5d-47cd-4e92-b6e0-17ad7eff3374 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:25.203302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3fd12-e07a-4848-8788-f0688a909cb4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:25.238816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1163/2318] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:24 2022] POST /identity/v3/users => generated 298 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:25.257161 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1156/2319] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:24 2022] POST /identity/v3/users => generated 302 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:25.257496 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902dd5d-47cd-4e92-b6e0-17ad7eff3374 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:25.263251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3fd12-e07a-4848-8788-f0688a909cb4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:25.286431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3fd12-e07a-4848-8788-f0688a909cb4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:25.288019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902dd5d-47cd-4e92-b6e0-17ad7eff3374 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:25.293832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9756a4-f070-4c83-ae5a-416229bd5f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:25.296662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9756a4-f070-4c83-ae5a-416229bd5f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:25.297191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9756a4-f070-4c83-ae5a-416229bd5f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:25.297649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9756a4-f070-4c83-ae5a-416229bd5f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:25.298714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9756a4-f070-4c83-ae5a-416229bd5f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:25.301172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9756a4-f070-4c83-ae5a-416229bd5f07 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:25.304722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2cea1-43f5-4728-be92-504df64ff100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:25.305447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2cea1-43f5-4728-be92-504df64ff100 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:25.305832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2cea1-43f5-4728-be92-504df64ff100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:25.306179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2cea1-43f5-4728-be92-504df64ff100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:25.307024 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2cea1-43f5-4728-be92-504df64ff100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:25.320498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1157/2320] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:25.325392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9756a4-f070-4c83-ae5a-416229bd5f07 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:25.331903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2cea1-43f5-4728-be92-504df64ff100 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:25.351761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9756a4-f070-4c83-ae5a-416229bd5f07 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:25.360043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229c841-aef5-48d2-98f6-9cc76f4edf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:25.361251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229c841-aef5-48d2-98f6-9cc76f4edf84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:25.361761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229c841-aef5-48d2-98f6-9cc76f4edf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:25.362424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1164/2321] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:25.362826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229c841-aef5-48d2-98f6-9cc76f4edf84 admin admin] PATH_INFO: `/v3/projects/74cdd2ba4b20429a85bf4966954c5f5e/users/1db390bd9a9d48639dc4ab61f3c43568/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:25.367051 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2cea1-43f5-4728-be92-504df64ff100 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:25.388161 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229c841-aef5-48d2-98f6-9cc76f4edf84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cdd2ba4b20429a85bf4966954c5f5e, user_id=1db390bd9a9d48639dc4ab61f3c43568, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:25.392387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229c841-aef5-48d2-98f6-9cc76f4edf84 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:25.395568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2cea1-43f5-4728-be92-504df64ff100 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:25.416904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a438d8-074e-41e2-ad8d-7d202770a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:25.418121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a438d8-074e-41e2-ad8d-7d202770a9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:25.418313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a438d8-074e-41e2-ad8d-7d202770a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:25.418595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a438d8-074e-41e2-ad8d-7d202770a9ff admin admin] PATH_INFO: `/v3/projects/4cb2b48c293043a2aaac072c264302de/users/4be0f555ad2043b681a622f23d1ee1a3/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:25.431103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1158/2322] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:25 2022] PUT /identity/v3/projects/74cdd2ba4b20429a85bf4966954c5f5e/users/1db390bd9a9d48639dc4ab61f3c43568/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:25.436730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229c841-aef5-48d2-98f6-9cc76f4edf84 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:25.465086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a438d8-074e-41e2-ad8d-7d202770a9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb2b48c293043a2aaac072c264302de, user_id=4be0f555ad2043b681a622f23d1ee1a3, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:25.468634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a438d8-074e-41e2-ad8d-7d202770a9ff admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:25.504058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1165/2323] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:25 2022] PUT /identity/v3/projects/4cb2b48c293043a2aaac072c264302de/users/4be0f555ad2043b681a622f23d1ee1a3/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:25.505185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a438d8-074e-41e2-ad8d-7d202770a9ff admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:25.567846 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229c841-aef5-48d2-98f6-9cc76f4edf84 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:25.672822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc26c4-e078-419d-a6d6-4a69843497b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:25.676287 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc26c4-e078-419d-a6d6-4a69843497b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:25.676503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc26c4-e078-419d-a6d6-4a69843497b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:25.676804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc26c4-e078-419d-a6d6-4a69843497b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:25.678594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc26c4-e078-419d-a6d6-4a69843497b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:25.683056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc26c4-e078-419d-a6d6-4a69843497b1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:25.710108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a438d8-074e-41e2-ad8d-7d202770a9ff admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:25.721072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1159/2324] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:25.721710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab182-9dd1-4a98-9371-85a2680aab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:25.722184 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc26c4-e078-419d-a6d6-4a69843497b1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:25.723286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab182-9dd1-4a98-9371-85a2680aab51 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:25.724914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab182-9dd1-4a98-9371-85a2680aab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:25.725302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab182-9dd1-4a98-9371-85a2680aab51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:25.729266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ab182-9dd1-4a98-9371-85a2680aab51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:25.736054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ab182-9dd1-4a98-9371-85a2680aab51 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:25.737009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc26c4-e078-419d-a6d6-4a69843497b1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:25.743448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2a188-c888-4a50-88c2-ef75ab598237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:25.744448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a188-c888-4a50-88c2-ef75ab598237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:25.744791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a188-c888-4a50-88c2-ef75ab598237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:25.745076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a188-c888-4a50-88c2-ef75ab598237 admin admin] PATH_INFO: `/v3/projects/74cdd2ba4b20429a85bf4966954c5f5e/users/1db390bd9a9d48639dc4ab61f3c43568/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:25.747446 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2a188-c888-4a50-88c2-ef75ab598237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cdd2ba4b20429a85bf4966954c5f5e, user_id=1db390bd9a9d48639dc4ab61f3c43568, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:25.750674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2a188-c888-4a50-88c2-ef75ab598237 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:25.761490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:25.774919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1160/2325] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:25 2022] PUT /identity/v3/projects/74cdd2ba4b20429a85bf4966954c5f5e/users/1db390bd9a9d48639dc4ab61f3c43568/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:25.777163 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722a08-5e24-458f-9836-d92dad1cf046 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:25.777488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722a08-5e24-458f-9836-d92dad1cf046 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:25.777812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722a08-5e24-458f-9836-d92dad1cf046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:25.779792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1166/2326] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:10:25.781287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab182-9dd1-4a98-9371-85a2680aab51 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:25.809457 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab182-9dd1-4a98-9371-85a2680aab51 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:25.812618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a8722a08-5e24-458f-9836-d92dad1cf046 None None] MFA Rules not processed for user `1db390bd9a9d48639dc4ab61f3c43568`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:25.814022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a8722a08-5e24-458f-9836-d92dad1cf046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:25.823438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:25.994902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1161/2327] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:26.001057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9991bc-c7c8-4c9b-9c25-08bff78e900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:26.001968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9991bc-c7c8-4c9b-9c25-08bff78e900e admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:26.002248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9991bc-c7c8-4c9b-9c25-08bff78e900e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:26.002523 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9991bc-c7c8-4c9b-9c25-08bff78e900e admin admin] PATH_INFO: `/v3/projects/4cb2b48c293043a2aaac072c264302de/users/4be0f555ad2043b681a622f23d1ee1a3/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:26.004749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9991bc-c7c8-4c9b-9c25-08bff78e900e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb2b48c293043a2aaac072c264302de, user_id=4be0f555ad2043b681a622f23d1ee1a3, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:26.008086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8722a08-5e24-458f-9836-d92dad1cf046 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:26.009631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9991bc-c7c8-4c9b-9c25-08bff78e900e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:26.012466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a8722a08-5e24-458f-9836-d92dad1cf046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:26.052013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1167/2328] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:25 2022] PUT /identity/v3/projects/4cb2b48c293043a2aaac072c264302de/users/4be0f555ad2043b681a622f23d1ee1a3/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:26.154982 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8722a08-5e24-458f-9836-d92dad1cf046 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:26.306114 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a24b52-c761-4445-9d68-3a00d40480e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:26.306913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a24b52-c761-4445-9d68-3a00d40480e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:26.307283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a24b52-c761-4445-9d68-3a00d40480e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:26.307627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a24b52-c761-4445-9d68-3a00d40480e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:26.434569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a24b52-c761-4445-9d68-3a00d40480e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:26.437127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a24b52-c761-4445-9d68-3a00d40480e2 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:26.452012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1162/2329] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:26.542633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9991bc-c7c8-4c9b-9c25-08bff78e900e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:26.545660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5e9991bc-c7c8-4c9b-9c25-08bff78e900e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:26.580362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9991bc-c7c8-4c9b-9c25-08bff78e900e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:26.591344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d8670-fc43-4849-95b9-e16444b685db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:26.592469 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8670-fc43-4849-95b9-e16444b685db service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:26.592754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8670-fc43-4849-95b9-e16444b685db service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:26.593033 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8670-fc43-4849-95b9-e16444b685db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:26.704318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d8670-fc43-4849-95b9-e16444b685db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:26.705783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d8670-fc43-4849-95b9-e16444b685db service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:26.766200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1168/2330] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:33.301956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a24b52-c761-4445-9d68-3a00d40480e2 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:33.332311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:33.491951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a24b52-c761-4445-9d68-3a00d40480e2 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:33.500998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:33.501643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:33.501999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:33.502363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] PATH_INFO: `/v3/users/a840984f51c94ce8b66f98e961a09b25` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:33.505196 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a840984f51c94ce8b66f98e961a09b25)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:33.508623 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:33.651615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a840984f51c94ce8b66f98e961a09b25'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:33.667195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a840984f51c94ce8b66f98e961a09b25'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:33.669770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a840984f51c94ce8b66f98e961a09b25'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:33.669770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a840984f51c94ce8b66f98e961a09b25'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:33.714041 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a840984f51c94ce8b66f98e961a09b25'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:33.744596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1163/2331] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:33 2022] DELETE /identity/v3/users/a840984f51c94ce8b66f98e961a09b25 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:33.749908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3450c-e130-4f4b-ac76-69b75e201ada None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:33.750496 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3450c-e130-4f4b-ac76-69b75e201ada None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:33.750496 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3450c-e130-4f4b-ac76-69b75e201ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:33.783879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cdc3450c-e130-4f4b-ac76-69b75e201ada None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:33.793410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cdc3450c-e130-4f4b-ac76-69b75e201ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:33.936503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1169/2332] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:33.944898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:33.948282 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:34.071694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca80cf-c510-4f19-900b-a4a0b47f6851 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:34.087808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde4892-0645-4893-8d61-e76fc1da817d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:34.087808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde4892-0645-4893-8d61-e76fc1da817d service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:34.087808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde4892-0645-4893-8d61-e76fc1da817d service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:34.087808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde4892-0645-4893-8d61-e76fc1da817d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:34.104649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde4892-0645-4893-8d61-e76fc1da817d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:34.112537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde4892-0645-4893-8d61-e76fc1da817d service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:34.137004 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1164/2333] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:34.601557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f596e-4d89-4c0c-9170-9847ca1e6516 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:34.602459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f596e-4d89-4c0c-9170-9847ca1e6516 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:34.603947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f596e-4d89-4c0c-9170-9847ca1e6516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:34.642384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde4892-0645-4893-8d61-e76fc1da817d service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:34.651598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1fde4892-0645-4893-8d61-e76fc1da817d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:34.675807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde4892-0645-4893-8d61-e76fc1da817d service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:34.683091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:34.684805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:34.685098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:34.686372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] PATH_INFO: `/v3/projects/46cf018dea2a46089c1b6f1a3b28a4c0` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:34.687716 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=46cf018dea2a46089c1b6f1a3b28a4c0)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:34.691621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:34.691990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-323f596e-4d89-4c0c-9170-9847ca1e6516 None None] MFA Rules not processed for user `4be0f555ad2043b681a622f23d1ee1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:34.693311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-323f596e-4d89-4c0c-9170-9847ca1e6516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:34.729645 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:34.740748 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:34.764866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46cf018dea2a46089c1b6f1a3b28a4c0', 'request_id': 'req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:34.772487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46cf018dea2a46089c1b6f1a3b28a4c0', 'request_id': 'req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:34.778998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46cf018dea2a46089c1b6f1a3b28a4c0', 'request_id': 'req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:34.790056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] The token cache is being invalidate because project 46cf018dea2a46089c1b6f1a3b28a4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:34.790519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:34.791227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:34.792771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1165/2334] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:34 2022] DELETE /identity/v3/projects/46cf018dea2a46089c1b6f1a3b28a4c0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:34.794961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1170/2335] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:34.796596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:34.798063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:34.861662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6c22e-950c-48e4-9ab9-4c60e5a521cf admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:34.868022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:34.869475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:34.869892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:34.870406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] PATH_INFO: `/v3/users/1db390bd9a9d48639dc4ab61f3c43568` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:34.873588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db390bd9a9d48639dc4ab61f3c43568)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:34.876015 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:34.922805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db390bd9a9d48639dc4ab61f3c43568'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:34.929896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db390bd9a9d48639dc4ab61f3c43568'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:34.930595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db390bd9a9d48639dc4ab61f3c43568'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:34.931348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db390bd9a9d48639dc4ab61f3c43568'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:34.944970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-76a477e7-b0e9-4a81-b4a1-a1041094f9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db390bd9a9d48639dc4ab61f3c43568'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:34.960168 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1166/2336] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:34 2022] DELETE /identity/v3/users/1db390bd9a9d48639dc4ab61f3c43568 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:35.257028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f596e-4d89-4c0c-9170-9847ca1e6516 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:35.270068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f596e-4d89-4c0c-9170-9847ca1e6516 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:35.336575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:35.337481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:35.338045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:35.338359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] PATH_INFO: `/v3/projects/74cdd2ba4b20429a85bf4966954c5f5e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:35.343023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cdd2ba4b20429a85bf4966954c5f5e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:35.343640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:35.407171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cdd2ba4b20429a85bf4966954c5f5e', 'request_id': 'req-ecc2108f-b633-4dd5-9066-f777b6920754'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:35.414885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cdd2ba4b20429a85bf4966954c5f5e', 'request_id': 'req-ecc2108f-b633-4dd5-9066-f777b6920754'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:35.422233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cdd2ba4b20429a85bf4966954c5f5e', 'request_id': 'req-ecc2108f-b633-4dd5-9066-f777b6920754'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:35.434862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] The token cache is being invalidate because project 74cdd2ba4b20429a85bf4966954c5f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:35.435297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:35.435970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-ecc2108f-b633-4dd5-9066-f777b6920754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:35.437578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1171/2337] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:35 2022] DELETE /identity/v3/projects/74cdd2ba4b20429a85bf4966954c5f5e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:35.443414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21378c6-9948-4cf3-8149-0c650acc6ad7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:35.443818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21378c6-9948-4cf3-8149-0c650acc6ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:35.444161 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21378c6-9948-4cf3-8149-0c650acc6ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:35.472045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c21378c6-9948-4cf3-8149-0c650acc6ad7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:35.473394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c21378c6-9948-4cf3-8149-0c650acc6ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:35.514145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:35.555813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1167/2338] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:35.566435 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108afc-918f-45f5-95ee-cd6089159476 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:35.566781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108afc-918f-45f5-95ee-cd6089159476 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:35.567062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108afc-918f-45f5-95ee-cd6089159476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:35.588426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e1108afc-918f-45f5-95ee-cd6089159476 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:35.590052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e1108afc-918f-45f5-95ee-cd6089159476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:35.601530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1172/2339] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:35.606303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21378c6-9948-4cf3-8149-0c650acc6ad7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:35.616570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21378c6-9948-4cf3-8149-0c650acc6ad7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:35.621245 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeba5b5-cdab-4b32-b603-bb2044415889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:35.622631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeba5b5-cdab-4b32-b603-bb2044415889 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:35.623043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeba5b5-cdab-4b32-b603-bb2044415889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:35.623324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeba5b5-cdab-4b32-b603-bb2044415889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:35.624134 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeba5b5-cdab-4b32-b603-bb2044415889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:10:35.624589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeba5b5-cdab-4b32-b603-bb2044415889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:35.626689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeba5b5-cdab-4b32-b603-bb2044415889 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:35.640870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1168/2340] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:10:35.647473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108afc-918f-45f5-95ee-cd6089159476 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:35.660700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108afc-918f-45f5-95ee-cd6089159476 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:35.670841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a035578-cee4-4575-b312-639ec50f6eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:35.671514 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035578-cee4-4575-b312-639ec50f6eba admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:35.671798 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035578-cee4-4575-b312-639ec50f6eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:35.672096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035578-cee4-4575-b312-639ec50f6eba admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:35.672818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a035578-cee4-4575-b312-639ec50f6eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:35.674748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a035578-cee4-4575-b312-639ec50f6eba admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:35.708213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1173/2341] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:35 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:35.712382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeba5b5-cdab-4b32-b603-bb2044415889 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:35.726780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeba5b5-cdab-4b32-b603-bb2044415889 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:35.855858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c50f1-d91a-4723-8dda-6589d407102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:35.857550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c50f1-d91a-4723-8dda-6589d407102b admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:35.857844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c50f1-d91a-4723-8dda-6589d407102b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:35.858120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c50f1-d91a-4723-8dda-6589d407102b admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:35.859225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c50f1-d91a-4723-8dda-6589d407102b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:35.861862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c50f1-d91a-4723-8dda-6589d407102b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:35.892825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1169/2342] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:35 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:35.896554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a035578-cee4-4575-b312-639ec50f6eba admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:35.911001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a035578-cee4-4575-b312-639ec50f6eba admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:35.916292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e7740-ea3e-4a62-b770-36049508d33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:35.917245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7740-ea3e-4a62-b770-36049508d33d admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:35.917687 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7740-ea3e-4a62-b770-36049508d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:35.918314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7740-ea3e-4a62-b770-36049508d33d admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:35.919825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e7740-ea3e-4a62-b770-36049508d33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:35.922174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e7740-ea3e-4a62-b770-36049508d33d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:35.936382 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1174/2343] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:35.940756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c50f1-d91a-4723-8dda-6589d407102b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:35.960933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c50f1-d91a-4723-8dda-6589d407102b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:35.969499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3922fc-f538-412c-89d7-830b4b48634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:35.970218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3922fc-f538-412c-89d7-830b4b48634f admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:35.970614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3922fc-f538-412c-89d7-830b4b48634f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:35.970864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3922fc-f538-412c-89d7-830b4b48634f admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:35.971600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3922fc-f538-412c-89d7-830b4b48634f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:35.973263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3922fc-f538-412c-89d7-830b4b48634f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:35.992780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1170/2344] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:35.997048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e7740-ea3e-4a62-b770-36049508d33d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:36.014150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e7740-ea3e-4a62-b770-36049508d33d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:36.018943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62b41-9376-4eca-ac64-7e4f826d2e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:36.019825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62b41-9376-4eca-ac64-7e4f826d2e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:36.020103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62b41-9376-4eca-ac64-7e4f826d2e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:36.020372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62b41-9376-4eca-ac64-7e4f826d2e91 admin admin] PATH_INFO: `/v3/projects/8a4b14d41aad4737a8a76339c19fba61/users/3fb2c2c42f9b40b5b9caaaedb79d2e7d/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:36.023567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:36.040348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e62b41-9376-4eca-ac64-7e4f826d2e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4b14d41aad4737a8a76339c19fba61, user_id=3fb2c2c42f9b40b5b9caaaedb79d2e7d, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:36.043761 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e62b41-9376-4eca-ac64-7e4f826d2e91 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:36.061680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1175/2345] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:35 2022] PUT /identity/v3/projects/8a4b14d41aad4737a8a76339c19fba61/users/3fb2c2c42f9b40b5b9caaaedb79d2e7d/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:36.073036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c90daa-7809-4a42-917f-dfab1c8525df None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:36.073323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c90daa-7809-4a42-917f-dfab1c8525df None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:36.073639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c90daa-7809-4a42-917f-dfab1c8525df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:36.104805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-97c90daa-7809-4a42-917f-dfab1c8525df None None] MFA Rules not processed for user `3fb2c2c42f9b40b5b9caaaedb79d2e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:36.106331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-97c90daa-7809-4a42-917f-dfab1c8525df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:36.185785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1171/2346] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:36.190600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62b41-9376-4eca-ac64-7e4f826d2e91 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:36.313103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62b41-9376-4eca-ac64-7e4f826d2e91 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:36.318137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62383f-368d-42ae-a7cb-98763b3fbc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:36.318863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62383f-368d-42ae-a7cb-98763b3fbc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:36.319147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62383f-368d-42ae-a7cb-98763b3fbc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:36.319424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62383f-368d-42ae-a7cb-98763b3fbc28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:36.320125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62383f-368d-42ae-a7cb-98763b3fbc28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:36.322067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62383f-368d-42ae-a7cb-98763b3fbc28 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:36.361469 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1176/2347] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:36 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:36.365301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c90daa-7809-4a42-917f-dfab1c8525df None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:36.378300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c90daa-7809-4a42-917f-dfab1c8525df None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:36.428304 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:36.485400 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589aa0f-351b-41c2-a879-e09318eb0bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:36.486394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589aa0f-351b-41c2-a879-e09318eb0bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:36.486968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589aa0f-351b-41c2-a879-e09318eb0bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:36.488604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589aa0f-351b-41c2-a879-e09318eb0bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:36.491390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589aa0f-351b-41c2-a879-e09318eb0bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:36.494236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589aa0f-351b-41c2-a879-e09318eb0bb4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:36.538736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1172/2348] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:36 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:36.543014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62383f-368d-42ae-a7cb-98763b3fbc28 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:36.558529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62383f-368d-42ae-a7cb-98763b3fbc28 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:36.567524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad4721-0a67-4d95-a93b-3d95799cb1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:36.567808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad4721-0a67-4d95-a93b-3d95799cb1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:36.568105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad4721-0a67-4d95-a93b-3d95799cb1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:36.568449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad4721-0a67-4d95-a93b-3d95799cb1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:36.569429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad4721-0a67-4d95-a93b-3d95799cb1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:36.570897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad4721-0a67-4d95-a93b-3d95799cb1e7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:36.584789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1177/2349] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:10:36.588575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589aa0f-351b-41c2-a879-e09318eb0bb4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:36.601812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589aa0f-351b-41c2-a879-e09318eb0bb4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:36.611254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e48272-6e09-4787-9bb5-5538be310c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:36.612170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48272-6e09-4787-9bb5-5538be310c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:36.612444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48272-6e09-4787-9bb5-5538be310c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:36.612723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48272-6e09-4787-9bb5-5538be310c59 admin admin] PATH_INFO: `/v3/projects/49db21c4a2f74020ae5617c8f278d2e3/users/1f575bfd82f042dca9be892c7cb3c5e1/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:36.633160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e48272-6e09-4787-9bb5-5538be310c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49db21c4a2f74020ae5617c8f278d2e3, user_id=1f575bfd82f042dca9be892c7cb3c5e1, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:36.636969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e48272-6e09-4787-9bb5-5538be310c59 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:36.672589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1173/2350] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:36 2022] PUT /identity/v3/projects/49db21c4a2f74020ae5617c8f278d2e3/users/1f575bfd82f042dca9be892c7cb3c5e1/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:36.673617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad4721-0a67-4d95-a93b-3d95799cb1e7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:36.692212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad4721-0a67-4d95-a93b-3d95799cb1e7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:36.813936 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b561ed-b19b-47a4-9b7c-b2c58e1cc162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:36.814823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b561ed-b19b-47a4-9b7c-b2c58e1cc162 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:36.815250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b561ed-b19b-47a4-9b7c-b2c58e1cc162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:36.815830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b561ed-b19b-47a4-9b7c-b2c58e1cc162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:36.816666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b561ed-b19b-47a4-9b7c-b2c58e1cc162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:36.818375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b561ed-b19b-47a4-9b7c-b2c58e1cc162 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:36.831237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1178/2351] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:36.839188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e48272-6e09-4787-9bb5-5538be310c59 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:36.860963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e48272-6e09-4787-9bb5-5538be310c59 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:36.875217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122255de-1943-4aad-b412-47164261be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:36.876303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122255de-1943-4aad-b412-47164261be06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:36.876658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122255de-1943-4aad-b412-47164261be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:36.876948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122255de-1943-4aad-b412-47164261be06 admin admin] PATH_INFO: `/v3/projects/49db21c4a2f74020ae5617c8f278d2e3/users/1f575bfd82f042dca9be892c7cb3c5e1/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:36.880808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122255de-1943-4aad-b412-47164261be06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49db21c4a2f74020ae5617c8f278d2e3, user_id=1f575bfd82f042dca9be892c7cb3c5e1, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:36.885384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122255de-1943-4aad-b412-47164261be06 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:36.888916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956821e9-92cb-4ab4-b7d6-46f05afd47e2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:36.889537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956821e9-92cb-4ab4-b7d6-46f05afd47e2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:36.889820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956821e9-92cb-4ab4-b7d6-46f05afd47e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:36.918445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1174/2352] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:36 2022] PUT /identity/v3/projects/49db21c4a2f74020ae5617c8f278d2e3/users/1f575bfd82f042dca9be892c7cb3c5e1/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:36.920545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-956821e9-92cb-4ab4-b7d6-46f05afd47e2 None None] MFA Rules not processed for user `a57822c1558143d38ad17326a742c370`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:36.922019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-956821e9-92cb-4ab4-b7d6-46f05afd47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:36.929728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960df0a-fed7-4374-a9b2-ace61aaefe0a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:36.930022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960df0a-fed7-4374-a9b2-ace61aaefe0a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:36.930296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960df0a-fed7-4374-a9b2-ace61aaefe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:36.991769 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0960df0a-fed7-4374-a9b2-ace61aaefe0a None None] MFA Rules not processed for user `1f575bfd82f042dca9be892c7cb3c5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:36.993208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0960df0a-fed7-4374-a9b2-ace61aaefe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:37.010037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:37.028684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1179/2353] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:37.134933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1175/2354] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:37.140039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956821e9-92cb-4ab4-b7d6-46f05afd47e2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:37.141519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-956821e9-92cb-4ab4-b7d6-46f05afd47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:37.206583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956821e9-92cb-4ab4-b7d6-46f05afd47e2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:37.210314 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85280be5-ff0d-4219-93d8-bc3fa5d8bee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:37.211021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85280be5-ff0d-4219-93d8-bc3fa5d8bee9 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:37.211308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85280be5-ff0d-4219-93d8-bc3fa5d8bee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:37.211586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85280be5-ff0d-4219-93d8-bc3fa5d8bee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:37.221636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85280be5-ff0d-4219-93d8-bc3fa5d8bee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:37.223128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85280be5-ff0d-4219-93d8-bc3fa5d8bee9 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:37.233495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1180/2355] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:37.611379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960df0a-fed7-4374-a9b2-ace61aaefe0a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:37.678824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960df0a-fed7-4374-a9b2-ace61aaefe0a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:37.683608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:37.684685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:37.684973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:37.685405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] PATH_INFO: `/v3/users/3fb2c2c42f9b40b5b9caaaedb79d2e7d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:37.687763 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb2c2c42f9b40b5b9caaaedb79d2e7d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:37.688866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:37.702040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:37.752571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb2c2c42f9b40b5b9caaaedb79d2e7d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:37.759880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb2c2c42f9b40b5b9caaaedb79d2e7d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:37.760516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb2c2c42f9b40b5b9caaaedb79d2e7d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:37.761152 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb2c2c42f9b40b5b9caaaedb79d2e7d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:37.772837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb2c2c42f9b40b5b9caaaedb79d2e7d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:37.786358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1176/2356] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:37 2022] DELETE /identity/v3/users/3fb2c2c42f9b40b5b9caaaedb79d2e7d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:37.791373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d701fa4-e5f7-4a13-bf91-a04d4d0b368d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:37.791714 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d701fa4-e5f7-4a13-bf91-a04d4d0b368d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:37.791996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d701fa4-e5f7-4a13-bf91-a04d4d0b368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:37.810409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9d701fa4-e5f7-4a13-bf91-a04d4d0b368d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:37.811641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9d701fa4-e5f7-4a13-bf91-a04d4d0b368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:37.872111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1181/2357] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:37.882827 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:37.884264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:37.943003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569857fe-bfa5-409b-ae89-2b208ff3d162 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:37.947901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757cf8f-4ada-4302-8bca-fc7c482c2bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:37.948553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757cf8f-4ada-4302-8bca-fc7c482c2bac service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:37.948836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757cf8f-4ada-4302-8bca-fc7c482c2bac service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:37.949113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757cf8f-4ada-4302-8bca-fc7c482c2bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:37.960002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757cf8f-4ada-4302-8bca-fc7c482c2bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:37.961444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757cf8f-4ada-4302-8bca-fc7c482c2bac service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:37.971927 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1177/2358] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:38.192701 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d701fa4-e5f7-4a13-bf91-a04d4d0b368d None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:38.194336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9d701fa4-e5f7-4a13-bf91-a04d4d0b368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:38.207234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d701fa4-e5f7-4a13-bf91-a04d4d0b368d None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:38.213513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:38.214447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:38.214768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:38.215028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] PATH_INFO: `/v3/users/3dac15058f404f01a9a5fd5936efd327` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:38.217639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dac15058f404f01a9a5fd5936efd327)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:38.220595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:38.273467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757cf8f-4ada-4302-8bca-fc7c482c2bac service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:38.276566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f757cf8f-4ada-4302-8bca-fc7c482c2bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:38.295307 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dac15058f404f01a9a5fd5936efd327'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.299944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dac15058f404f01a9a5fd5936efd327'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.304069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757cf8f-4ada-4302-8bca-fc7c482c2bac service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:38.315743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:38.316756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:38.318130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:38.319372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] PATH_INFO: `/v3/projects/8a4b14d41aad4737a8a76339c19fba61` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:38.321127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4b14d41aad4737a8a76339c19fba61)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:38.324680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:38.325429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dac15058f404f01a9a5fd5936efd327'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.326132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dac15058f404f01a9a5fd5936efd327'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.344686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8fa7c659-b968-4429-b79d-bddd2f016aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dac15058f404f01a9a5fd5936efd327'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.362296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1182/2359] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:38 2022] DELETE /identity/v3/users/3dac15058f404f01a9a5fd5936efd327 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:38.366967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5efcc0-f8bd-4456-a7c4-c38669888ef9 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:38.367264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5efcc0-f8bd-4456-a7c4-c38669888ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:38.367560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5efcc0-f8bd-4456-a7c4-c38669888ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:38.387120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4b14d41aad4737a8a76339c19fba61', 'request_id': 'req-e44435f2-384a-4b56-8256-2a752abe0d9a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.391725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-0d5efcc0-f8bd-4456-a7c4-c38669888ef9 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:38.393109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0d5efcc0-f8bd-4456-a7c4-c38669888ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:38.403066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4b14d41aad4737a8a76339c19fba61', 'request_id': 'req-e44435f2-384a-4b56-8256-2a752abe0d9a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.405352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:38.412812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4b14d41aad4737a8a76339c19fba61', 'request_id': 'req-e44435f2-384a-4b56-8256-2a752abe0d9a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.425912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] The token cache is being invalidate because project 8a4b14d41aad4737a8a76339c19fba61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:38.426502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.427436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.429317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1178/2360] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:38 2022] DELETE /identity/v3/projects/8a4b14d41aad4737a8a76339c19fba61 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:38.433108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:38.435084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:38.455000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:38.474894 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1183/2361] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:38.480791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5efcc0-f8bd-4456-a7c4-c38669888ef9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:38.482331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0d5efcc0-f8bd-4456-a7c4-c38669888ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:38.533747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44435f2-384a-4b56-8256-2a752abe0d9a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:38.539308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:38.540296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:38.540646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:38.540984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] PATH_INFO: `/v3/users/1f575bfd82f042dca9be892c7cb3c5e1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:38.542286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f575bfd82f042dca9be892c7cb3c5e1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:38.544908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:38.549379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5efcc0-f8bd-4456-a7c4-c38669888ef9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:38.554081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a653-0084-4ff9-ba39-ea4b3d08ad32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:38.554829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a653-0084-4ff9-ba39-ea4b3d08ad32 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:38.555908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a653-0084-4ff9-ba39-ea4b3d08ad32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:38.556322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a653-0084-4ff9-ba39-ea4b3d08ad32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:38.571011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6a653-0084-4ff9-ba39-ea4b3d08ad32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:38.572481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6a653-0084-4ff9-ba39-ea4b3d08ad32 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:38.586099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1184/2362] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:38.604421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f575bfd82f042dca9be892c7cb3c5e1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.617685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f575bfd82f042dca9be892c7cb3c5e1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.618444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f575bfd82f042dca9be892c7cb3c5e1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.619097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f575bfd82f042dca9be892c7cb3c5e1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.633259 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f575bfd82f042dca9be892c7cb3c5e1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:38.651459 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1179/2363] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:38 2022] DELETE /identity/v3/users/1f575bfd82f042dca9be892c7cb3c5e1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:39.234985 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a653-0084-4ff9-ba39-ea4b3d08ad32 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:39.237006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9ae6a653-0084-4ff9-ba39-ea4b3d08ad32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:39.252857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a653-0084-4ff9-ba39-ea4b3d08ad32 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:39.338804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:39.344522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:39.353022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:39.354125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.354413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.354694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] PATH_INFO: `/v3/projects/9272d702579f426d805447236e77e208` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.356068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9272d702579f426d805447236e77e208)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:39.359211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:39.360138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4105b-6b36-4cae-9b89-e06a8b0797fd admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:39.365139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:39.366027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.366308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.366582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] PATH_INFO: `/v3/projects/49db21c4a2f74020ae5617c8f278d2e3` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.367924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49db21c4a2f74020ae5617c8f278d2e3)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:39.369829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:39.428772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9272d702579f426d805447236e77e208', 'request_id': 'req-736c6d51-9ad6-4549-b40c-3d45f3bc565c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:39.438594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9272d702579f426d805447236e77e208', 'request_id': 'req-736c6d51-9ad6-4549-b40c-3d45f3bc565c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:39.440445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49db21c4a2f74020ae5617c8f278d2e3', 'request_id': 'req-9d4e346b-62b7-48d6-9f58-56f9a8655b11'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:39.444032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:39.447003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9272d702579f426d805447236e77e208', 'request_id': 'req-736c6d51-9ad6-4549-b40c-3d45f3bc565c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:39.449455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49db21c4a2f74020ae5617c8f278d2e3', 'request_id': 'req-9d4e346b-62b7-48d6-9f58-56f9a8655b11'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:39.460435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49db21c4a2f74020ae5617c8f278d2e3', 'request_id': 'req-9d4e346b-62b7-48d6-9f58-56f9a8655b11'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:39.465816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] The token cache is being invalidate because project 9272d702579f426d805447236e77e208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:39.466190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:39.466942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-736c6d51-9ad6-4549-b40c-3d45f3bc565c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:39.468758 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1185/2364] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:39 2022] DELETE /identity/v3/projects/9272d702579f426d805447236e77e208 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:39.471774 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] The token cache is being invalidate because project 49db21c4a2f74020ae5617c8f278d2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:39.472306 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:39.473057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9d4e346b-62b7-48d6-9f58-56f9a8655b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:39.473487 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98531051-9cf0-4b08-968f-79edb4c5af98 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.473841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98531051-9cf0-4b08-968f-79edb4c5af98 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.474185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98531051-9cf0-4b08-968f-79edb4c5af98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.474756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1180/2365] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:39 2022] DELETE /identity/v3/projects/49db21c4a2f74020ae5617c8f278d2e3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:39.479209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d7c6b-0bb3-474d-9aaf-0ce6b4fd9375 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.479494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d7c6b-0bb3-474d-9aaf-0ce6b4fd9375 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.479824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d7c6b-0bb3-474d-9aaf-0ce6b4fd9375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.496599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-98531051-9cf0-4b08-968f-79edb4c5af98 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:39.498747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-98531051-9cf0-4b08-968f-79edb4c5af98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:39.514552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ce6d7c6b-0bb3-474d-9aaf-0ce6b4fd9375 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:39.517263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ce6d7c6b-0bb3-474d-9aaf-0ce6b4fd9375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:39.532009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:39.606627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1186/2366] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:39.615296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b71e6a-2a4e-452e-bec4-0b7d86972691 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.615614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b71e6a-2a4e-452e-bec4-0b7d86972691 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.615894 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b71e6a-2a4e-452e-bec4-0b7d86972691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.635188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1181/2367] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:39.645334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25130fc5-02c2-47e2-813f-851ec3f4bf63 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.645800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25130fc5-02c2-47e2-813f-851ec3f4bf63 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.646081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25130fc5-02c2-47e2-813f-851ec3f4bf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.650306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d4b71e6a-2a4e-452e-bec4-0b7d86972691 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:39.653213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d4b71e6a-2a4e-452e-bec4-0b7d86972691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:39.662258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1187/2368] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:39.666710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b71e6a-2a4e-452e-bec4-0b7d86972691 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:39.670275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-25130fc5-02c2-47e2-813f-851ec3f4bf63 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:39.673615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-25130fc5-02c2-47e2-813f-851ec3f4bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:39.681509 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1182/2369] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:39.686271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b71e6a-2a4e-452e-bec4-0b7d86972691 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:39.687237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25130fc5-02c2-47e2-813f-851ec3f4bf63 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:39.696542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33203-268f-4967-83c9-f1cdcb75b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:39.697234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33203-268f-4967-83c9-f1cdcb75b445 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.697816 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33203-268f-4967-83c9-f1cdcb75b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.698106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33203-268f-4967-83c9-f1cdcb75b445 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.698424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25130fc5-02c2-47e2-813f-851ec3f4bf63 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:39.699096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c33203-268f-4967-83c9-f1cdcb75b445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:10:39.699404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c33203-268f-4967-83c9-f1cdcb75b445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:39.702197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c33203-268f-4967-83c9-f1cdcb75b445 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:39.706009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ffe55-e45a-4e77-acf1-7022b2a9829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:39.706681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ffe55-e45a-4e77-acf1-7022b2a9829c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.706993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ffe55-e45a-4e77-acf1-7022b2a9829c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.707269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ffe55-e45a-4e77-acf1-7022b2a9829c admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.708128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ffe55-e45a-4e77-acf1-7022b2a9829c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:10:39.708436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ffe55-e45a-4e77-acf1-7022b2a9829c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:39.710494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ffe55-e45a-4e77-acf1-7022b2a9829c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:39.720984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1188/2370] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:10:39.725500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33203-268f-4967-83c9-f1cdcb75b445 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:39.739126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1183/2371] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:10:39.743457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ffe55-e45a-4e77-acf1-7022b2a9829c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:39.744607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33203-268f-4967-83c9-f1cdcb75b445 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:39.750501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8114aa-768a-4537-8884-463a47ef7de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:39.751219 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8114aa-768a-4537-8884-463a47ef7de4 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.751500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8114aa-768a-4537-8884-463a47ef7de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.751775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8114aa-768a-4537-8884-463a47ef7de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.752476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8114aa-768a-4537-8884-463a47ef7de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:39.754580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8114aa-768a-4537-8884-463a47ef7de4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:39.761742 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ffe55-e45a-4e77-acf1-7022b2a9829c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:39.766996 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74855f32-47f5-4a00-ae85-0271143b62ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:39.767723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74855f32-47f5-4a00-ae85-0271143b62ce admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.768020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74855f32-47f5-4a00-ae85-0271143b62ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.768299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74855f32-47f5-4a00-ae85-0271143b62ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.769157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74855f32-47f5-4a00-ae85-0271143b62ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:39.775904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74855f32-47f5-4a00-ae85-0271143b62ce admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:39.803989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1189/2372] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:39 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:39.805821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8114aa-768a-4537-8884-463a47ef7de4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:39.826346 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1184/2373] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:39 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:39.827354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74855f32-47f5-4a00-ae85-0271143b62ce admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:39.895774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8114aa-768a-4537-8884-463a47ef7de4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:39.925484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74855f32-47f5-4a00-ae85-0271143b62ce admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:39.932120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37074e8b-89d8-4ace-9ed1-311927dc6f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:39.935390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074e8b-89d8-4ace-9ed1-311927dc6f1d admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:39.936092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074e8b-89d8-4ace-9ed1-311927dc6f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:39.936515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074e8b-89d8-4ace-9ed1-311927dc6f1d admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:39.939240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37074e8b-89d8-4ace-9ed1-311927dc6f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:39.942505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37074e8b-89d8-4ace-9ed1-311927dc6f1d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:39.983292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1185/2374] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:39 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:10:39.985876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:39.990415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37074e8b-89d8-4ace-9ed1-311927dc6f1d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:40.008297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed092f8-2bc2-4412-b24e-e5c2833a8083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:40.009726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37074e8b-89d8-4ace-9ed1-311927dc6f1d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:40.010143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed092f8-2bc2-4412-b24e-e5c2833a8083 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.010811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed092f8-2bc2-4412-b24e-e5c2833a8083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.011369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed092f8-2bc2-4412-b24e-e5c2833a8083 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.012984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed092f8-2bc2-4412-b24e-e5c2833a8083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:40.015349 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed092f8-2bc2-4412-b24e-e5c2833a8083 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:40.016485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87690-2f70-4b51-b7bb-177412713037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:40.017287 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87690-2f70-4b51-b7bb-177412713037 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.017673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87690-2f70-4b51-b7bb-177412713037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.018054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87690-2f70-4b51-b7bb-177412713037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.019120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e87690-2f70-4b51-b7bb-177412713037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:40.022211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e87690-2f70-4b51-b7bb-177412713037 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:40.046799 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1186/2375] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:40.047520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1190/2376] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:39 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:40.052303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87690-2f70-4b51-b7bb-177412713037 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:40.052469 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed092f8-2bc2-4412-b24e-e5c2833a8083 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:40.064924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed092f8-2bc2-4412-b24e-e5c2833a8083 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:40.073694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4b908-c4ea-439a-ae36-8f1cebd532a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:40.074430 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4b908-c4ea-439a-ae36-8f1cebd532a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.074831 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4b908-c4ea-439a-ae36-8f1cebd532a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.075161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4b908-c4ea-439a-ae36-8f1cebd532a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.076672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4b908-c4ea-439a-ae36-8f1cebd532a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:40.078558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4b908-c4ea-439a-ae36-8f1cebd532a8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:40.086138 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87690-2f70-4b51-b7bb-177412713037 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:40.092892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1191/2377] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:40.097253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4b908-c4ea-439a-ae36-8f1cebd532a8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:40.101961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a481f1-48f1-41a6-8f5d-a9bd40360aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:40.102836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a481f1-48f1-41a6-8f5d-a9bd40360aee admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.103217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a481f1-48f1-41a6-8f5d-a9bd40360aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.103703 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a481f1-48f1-41a6-8f5d-a9bd40360aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.104990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a481f1-48f1-41a6-8f5d-a9bd40360aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:40.107366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a481f1-48f1-41a6-8f5d-a9bd40360aee admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:40.109665 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4b908-c4ea-439a-ae36-8f1cebd532a8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:40.115506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db713b15-c819-4231-91f6-c433a1c614f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:40.116383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db713b15-c819-4231-91f6-c433a1c614f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.116690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db713b15-c819-4231-91f6-c433a1c614f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.116975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db713b15-c819-4231-91f6-c433a1c614f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.120774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db713b15-c819-4231-91f6-c433a1c614f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:40.122957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db713b15-c819-4231-91f6-c433a1c614f0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:40.128454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1187/2378] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:40.136557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1192/2379] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:10:40.141150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db713b15-c819-4231-91f6-c433a1c614f0 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:40.144478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a481f1-48f1-41a6-8f5d-a9bd40360aee admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:40.158194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db713b15-c819-4231-91f6-c433a1c614f0 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:40.158378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a481f1-48f1-41a6-8f5d-a9bd40360aee admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:40.162820 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe06d60-f17a-45f0-b12b-10449be2d8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:40.163170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dbfb5-3447-467c-bfd9-be755b22ece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:40.163726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe06d60-f17a-45f0-b12b-10449be2d8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.164012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe06d60-f17a-45f0-b12b-10449be2d8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.164291 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe06d60-f17a-45f0-b12b-10449be2d8cb admin admin] PATH_INFO: `/v3/projects/bfcac6234abb473aba962b7dc9e4a3c3/users/2b641e57278c40faa5d20ea1ef7154bd/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.164598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dbfb5-3447-467c-bfd9-be755b22ece4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.164990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dbfb5-3447-467c-bfd9-be755b22ece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.165452 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dbfb5-3447-467c-bfd9-be755b22ece4 admin admin] PATH_INFO: `/v3/projects/161d431c2963454989738365826aa933/users/36d317b144ac43819cce988c3539cc5c/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.189792 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dbfb5-3447-467c-bfd9-be755b22ece4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161d431c2963454989738365826aa933, user_id=36d317b144ac43819cce988c3539cc5c, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:40.191642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe06d60-f17a-45f0-b12b-10449be2d8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcac6234abb473aba962b7dc9e4a3c3, user_id=2b641e57278c40faa5d20ea1ef7154bd, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:40.192980 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dbfb5-3447-467c-bfd9-be755b22ece4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:40.194909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe06d60-f17a-45f0-b12b-10449be2d8cb admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:40.209314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1188/2380] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:40 2022] PUT /identity/v3/projects/161d431c2963454989738365826aa933/users/36d317b144ac43819cce988c3539cc5c/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:40.214774 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1193/2381] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:40 2022] PUT /identity/v3/projects/bfcac6234abb473aba962b7dc9e4a3c3/users/2b641e57278c40faa5d20ea1ef7154bd/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:10:40.225150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461cf0-cb22-41a0-b6d9-34c29cbf2f8f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.225603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461cf0-cb22-41a0-b6d9-34c29cbf2f8f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.225979 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461cf0-cb22-41a0-b6d9-34c29cbf2f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.266949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-08461cf0-cb22-41a0-b6d9-34c29cbf2f8f None None] MFA Rules not processed for user `36d317b144ac43819cce988c3539cc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:40.268518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-08461cf0-cb22-41a0-b6d9-34c29cbf2f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:40.280481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:40.287340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0f10b-3e18-4853-ae71-e55abd9b32f1 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.287885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0f10b-3e18-4853-ae71-e55abd9b32f1 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.287885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0f10b-3e18-4853-ae71-e55abd9b32f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.333207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-3be0f10b-3e18-4853-ae71-e55abd9b32f1 None None] MFA Rules not processed for user `2b641e57278c40faa5d20ea1ef7154bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:40.335177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3be0f10b-3e18-4853-ae71-e55abd9b32f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:40.361056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1189/2382] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:40.375841 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08461cf0-cb22-41a0-b6d9-34c29cbf2f8f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:40.379909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-08461cf0-cb22-41a0-b6d9-34c29cbf2f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:40.438945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1194/2383] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:40.450174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0f10b-3e18-4853-ae71-e55abd9b32f1 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:40.452006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3be0f10b-3e18-4853-ae71-e55abd9b32f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:40.459816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08461cf0-cb22-41a0-b6d9-34c29cbf2f8f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:40.465874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0f10b-3e18-4853-ae71-e55abd9b32f1 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:40.466099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d68647-7a1f-4ee1-aa66-c7f95dbc98b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:40.469341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d68647-7a1f-4ee1-aa66-c7f95dbc98b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.469341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d68647-7a1f-4ee1-aa66-c7f95dbc98b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.469341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d68647-7a1f-4ee1-aa66-c7f95dbc98b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.474900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa112c-9291-454f-8e25-1bd7073fc1de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:40.476748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa112c-9291-454f-8e25-1bd7073fc1de service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.477197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa112c-9291-454f-8e25-1bd7073fc1de service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.477622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa112c-9291-454f-8e25-1bd7073fc1de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.481545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d68647-7a1f-4ee1-aa66-c7f95dbc98b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:40.483626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d68647-7a1f-4ee1-aa66-c7f95dbc98b9 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:40.490045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa112c-9291-454f-8e25-1bd7073fc1de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:40.492512 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa112c-9291-454f-8e25-1bd7073fc1de service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:40.498077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1190/2384] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:40.505369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1195/2385] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:40.520877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d68647-7a1f-4ee1-aa66-c7f95dbc98b9 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:40.620200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d68647-7a1f-4ee1-aa66-c7f95dbc98b9 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:40.626319 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:40.627332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.627682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.628058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] PATH_INFO: `/v3/users/36d317b144ac43819cce988c3539cc5c` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.632202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d317b144ac43819cce988c3539cc5c)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:40.632202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:40.696484 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d317b144ac43819cce988c3539cc5c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:40.702987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:40.713347 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d317b144ac43819cce988c3539cc5c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:40.719022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d317b144ac43819cce988c3539cc5c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:40.720640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d317b144ac43819cce988c3539cc5c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:40.743038 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d317b144ac43819cce988c3539cc5c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:40.759088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1191/2386] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:10:40 2022] DELETE /identity/v3/users/36d317b144ac43819cce988c3539cc5c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:40.763893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2da641-cb4c-42d4-bf34-dda4df4734ab None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:40.764211 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2da641-cb4c-42d4-bf34-dda4df4734ab None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:40.764535 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2da641-cb4c-42d4-bf34-dda4df4734ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:40.803463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cd2da641-cb4c-42d4-bf34-dda4df4734ab None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:40.804684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cd2da641-cb4c-42d4-bf34-dda4df4734ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:40.959983 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1196/2387] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:40.970048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:40.971621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:41.065796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6d248-83e2-44aa-8c94-1508ec6e5643 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:41.070184 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc16042-4517-43a0-8f68-60872bfcc5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:41.070979 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc16042-4517-43a0-8f68-60872bfcc5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.071354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc16042-4517-43a0-8f68-60872bfcc5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.071690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc16042-4517-43a0-8f68-60872bfcc5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.083433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc16042-4517-43a0-8f68-60872bfcc5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:41.085050 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc16042-4517-43a0-8f68-60872bfcc5f6 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:41.097403 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1192/2388] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:41.407955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2da641-cb4c-42d4-bf34-dda4df4734ab None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:41.409528 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cd2da641-cb4c-42d4-bf34-dda4df4734ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:41.427793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2da641-cb4c-42d4-bf34-dda4df4734ab None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:41.436600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:41.437539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.437830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.438104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] PATH_INFO: `/v3/projects/161d431c2963454989738365826aa933` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.439420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=161d431c2963454989738365826aa933)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:41.442434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:41.454485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:41.493267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161d431c2963454989738365826aa933', 'request_id': 'req-40625acc-0336-442e-ba60-4434f4b65585'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:41.502768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161d431c2963454989738365826aa933', 'request_id': 'req-40625acc-0336-442e-ba60-4434f4b65585'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:41.509007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161d431c2963454989738365826aa933', 'request_id': 'req-40625acc-0336-442e-ba60-4434f4b65585'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:41.521205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] The token cache is being invalidate because project 161d431c2963454989738365826aa933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:10:41.521494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:41.522129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-40625acc-0336-442e-ba60-4434f4b65585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:10:41.523697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1197/2389] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:10:41 2022] DELETE /identity/v3/projects/161d431c2963454989738365826aa933 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:41.529366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6b2e-129d-4113-8d15-eec425bf1d91 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.529817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6b2e-129d-4113-8d15-eec425bf1d91 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.529924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef6b2e-129d-4113-8d15-eec425bf1d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.548529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c0ef6b2e-129d-4113-8d15-eec425bf1d91 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:41.549724 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c0ef6b2e-129d-4113-8d15-eec425bf1d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:41.611833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1193/2390] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:41.619668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f785-3ad8-442f-933b-e906e95534bd None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.619976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f785-3ad8-442f-933b-e906e95534bd None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.620285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f785-3ad8-442f-933b-e906e95534bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.640220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-54d5f785-3ad8-442f-933b-e906e95534bd None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:41.641441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-54d5f785-3ad8-442f-933b-e906e95534bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:41.649573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1198/2391] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:41.654059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef6b2e-129d-4113-8d15-eec425bf1d91 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:41.664391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef6b2e-129d-4113-8d15-eec425bf1d91 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:41.669038 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3e8ef-daf7-4133-ab69-99e8ca79b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:41.669678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3e8ef-daf7-4133-ab69-99e8ca79b4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.669965 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3e8ef-daf7-4133-ab69-99e8ca79b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.670242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3e8ef-daf7-4133-ab69-99e8ca79b4fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.671051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3e8ef-daf7-4133-ab69-99e8ca79b4fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:10:41.671360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3e8ef-daf7-4133-ab69-99e8ca79b4fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:41.673051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3e8ef-daf7-4133-ab69-99e8ca79b4fe admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:41.685692 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1194/2392] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:10:41.690043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5f785-3ad8-442f-933b-e906e95534bd None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:41.700595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5f785-3ad8-442f-933b-e906e95534bd None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:41.705553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14c17e-1215-4eb5-b89d-b50a1541e045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:41.706233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14c17e-1215-4eb5-b89d-b50a1541e045 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.706754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14c17e-1215-4eb5-b89d-b50a1541e045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.707044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14c17e-1215-4eb5-b89d-b50a1541e045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.707746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14c17e-1215-4eb5-b89d-b50a1541e045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:41.709707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14c17e-1215-4eb5-b89d-b50a1541e045 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:41.736601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1199/2393] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:10:41 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:10:41.740778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3e8ef-daf7-4133-ab69-99e8ca79b4fe admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:41.753383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3e8ef-daf7-4133-ab69-99e8ca79b4fe admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:41.815002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea7160-ffa8-4d26-8e73-85be855d0636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:41.815711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7160-ffa8-4d26-8e73-85be855d0636 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.816001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7160-ffa8-4d26-8e73-85be855d0636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.816279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7160-ffa8-4d26-8e73-85be855d0636 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.817144 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea7160-ffa8-4d26-8e73-85be855d0636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:41.819161 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea7160-ffa8-4d26-8e73-85be855d0636 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:41.826431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:41.843987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1195/2394] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:10:41 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:10:41.845515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14c17e-1215-4eb5-b89d-b50a1541e045 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:41.858500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14c17e-1215-4eb5-b89d-b50a1541e045 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:41.863443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d4ab3-5082-47bf-9af5-021b98f47d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:41.864117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d4ab3-5082-47bf-9af5-021b98f47d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.864398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d4ab3-5082-47bf-9af5-021b98f47d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.864669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d4ab3-5082-47bf-9af5-021b98f47d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.865393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d4ab3-5082-47bf-9af5-021b98f47d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:41.867128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d4ab3-5082-47bf-9af5-021b98f47d8a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:41.879143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1200/2395] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:41.883504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea7160-ffa8-4d26-8e73-85be855d0636 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:41.893916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea7160-ffa8-4d26-8e73-85be855d0636 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:41.898760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65830b-d6f3-4437-947a-9e6bf6d6961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:41.899456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65830b-d6f3-4437-947a-9e6bf6d6961a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.899735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65830b-d6f3-4437-947a-9e6bf6d6961a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.900005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65830b-d6f3-4437-947a-9e6bf6d6961a admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.900722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65830b-d6f3-4437-947a-9e6bf6d6961a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:41.902344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65830b-d6f3-4437-947a-9e6bf6d6961a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:41.915151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1196/2396] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:10:41.919981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d4ab3-5082-47bf-9af5-021b98f47d8a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:41.930149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d4ab3-5082-47bf-9af5-021b98f47d8a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:41.935880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431b38-186d-432d-919d-4da214739050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:41.936863 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431b38-186d-432d-919d-4da214739050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.937351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431b38-186d-432d-919d-4da214739050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.937607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431b38-186d-432d-919d-4da214739050 admin admin] PATH_INFO: `/v3/projects/c743c4e622a84f7e9a2bf858b3a164fe/users/7ca87844c7ef4b2da0a12915aeff81a0/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.955341 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431b38-186d-432d-919d-4da214739050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c743c4e622a84f7e9a2bf858b3a164fe, user_id=7ca87844c7ef4b2da0a12915aeff81a0, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:41.958099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431b38-186d-432d-919d-4da214739050 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:41.973065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1201/2397] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:10:41 2022] PUT /identity/v3/projects/c743c4e622a84f7e9a2bf858b3a164fe/users/7ca87844c7ef4b2da0a12915aeff81a0/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:10:41.978797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d313b-9d31-4513-be88-1477c89d53b9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:41.979181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d313b-9d31-4513-be88-1477c89d53b9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:41.979412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d313b-9d31-4513-be88-1477c89d53b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:41.998847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9f3d313b-9d31-4513-be88-1477c89d53b9 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:42.000264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9f3d313b-9d31-4513-be88-1477c89d53b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:42.071332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1197/2398] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:42.085485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431b38-186d-432d-919d-4da214739050 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:42.087225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9b431b38-186d-432d-919d-4da214739050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:42.149814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431b38-186d-432d-919d-4da214739050 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:42.154131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358793-8e4e-45eb-aecf-adb87fd8471c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:42.154798 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358793-8e4e-45eb-aecf-adb87fd8471c service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:42.155081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358793-8e4e-45eb-aecf-adb87fd8471c service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:42.155354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b358793-8e4e-45eb-aecf-adb87fd8471c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:42.164460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b358793-8e4e-45eb-aecf-adb87fd8471c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:42.165880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b358793-8e4e-45eb-aecf-adb87fd8471c service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:42.176411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1202/2399] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:42.838303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e66e-941c-4ae2-889a-edd2571f3311 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:42.838975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e66e-941c-4ae2-889a-edd2571f3311 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:42.838975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e66e-941c-4ae2-889a-edd2571f3311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:42.882201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5396e66e-941c-4ae2-889a-edd2571f3311 None None] MFA Rules not processed for user `7ca87844c7ef4b2da0a12915aeff81a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:42.883645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5396e66e-941c-4ae2-889a-edd2571f3311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:42.971633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1198/2400] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:42.983558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358793-8e4e-45eb-aecf-adb87fd8471c service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:42.984959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0b358793-8e4e-45eb-aecf-adb87fd8471c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:43.046926 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:43.051367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d6a7d-2deb-4d35-907d-f453834e027f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:43.051672 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d6a7d-2deb-4d35-907d-f453834e027f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:43.051975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d6a7d-2deb-4d35-907d-f453834e027f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:43.064679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b358793-8e4e-45eb-aecf-adb87fd8471c service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:43.068297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259f577-5790-4d86-9add-afa496bf709b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:43.068942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259f577-5790-4d86-9add-afa496bf709b service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:43.069226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259f577-5790-4d86-9add-afa496bf709b service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:43.069505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259f577-5790-4d86-9add-afa496bf709b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:43.071434 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fb7d6a7d-2deb-4d35-907d-f453834e027f None None] MFA Rules not processed for user `2b641e57278c40faa5d20ea1ef7154bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:43.072633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fb7d6a7d-2deb-4d35-907d-f453834e027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:43.078901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259f577-5790-4d86-9add-afa496bf709b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:43.080341 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259f577-5790-4d86-9add-afa496bf709b service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:43.094251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1203/2401] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:10:43.148470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1199/2402] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:10:43.313817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259f577-5790-4d86-9add-afa496bf709b service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:43.315898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5259f577-5790-4d86-9add-afa496bf709b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:43.426807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259f577-5790-4d86-9add-afa496bf709b service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:43.430564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baaec4-405a-4169-a8fc-cfb53f83c707 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a5d7aee47e43e9904a93c6ce3bb412', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:43.431376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baaec4-405a-4169-a8fc-cfb53f83c707 service glance] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:43.431711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baaec4-405a-4169-a8fc-cfb53f83c707 service glance] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:43.432059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baaec4-405a-4169-a8fc-cfb53f83c707 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:43.434930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c3baaec4-405a-4169-a8fc-cfb53f83c707 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:43.501664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baaec4-405a-4169-a8fc-cfb53f83c707 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:43.503174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baaec4-405a-4169-a8fc-cfb53f83c707 service glance] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:43.512686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1204/2403] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:43.646540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8d669-8211-4c6e-8437-40a26d8e4760 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:43.646930 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8d669-8211-4c6e-8437-40a26d8e4760 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:43.647209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8d669-8211-4c6e-8437-40a26d8e4760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:43.663823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:43.707518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-59d8d669-8211-4c6e-8437-40a26d8e4760 None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:43.708731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-59d8d669-8211-4c6e-8437-40a26d8e4760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:43.775003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1200/2404] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:10:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:43.816782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baaec4-405a-4169-a8fc-cfb53f83c707 service glance] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:43.818198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c3baaec4-405a-4169-a8fc-cfb53f83c707 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:43.904412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:10:43.913628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baaec4-405a-4169-a8fc-cfb53f83c707 service glance] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:43.919519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d3899-7592-4ac1-bf34-9f36418a1327 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:43.920164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3899-7592-4ac1-bf34-9f36418a1327 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:43.920433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3899-7592-4ac1-bf34-9f36418a1327 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:43.920715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3899-7592-4ac1-bf34-9f36418a1327 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:43.928917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d3899-7592-4ac1-bf34-9f36418a1327 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:43.930500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d3899-7592-4ac1-bf34-9f36418a1327 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:43.939158 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1205/2405] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:10:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:10:45.555083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a59e-743e-40df-97ef-40c10a545f44 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:45.555083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a59e-743e-40df-97ef-40c10a545f44 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:45.555083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a59e-743e-40df-97ef-40c10a545f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:45.575310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1957a59e-743e-40df-97ef-40c10a545f44 None None] MFA Rules not processed for user `7ca87844c7ef4b2da0a12915aeff81a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:45.577017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1957a59e-743e-40df-97ef-40c10a545f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:45.584426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1201/2406] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:48.514690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d3899-7592-4ac1-bf34-9f36418a1327 service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:10:48.517742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-748d3899-7592-4ac1-bf34-9f36418a1327 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:48.701304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d3899-7592-4ac1-bf34-9f36418a1327 service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:10:48.709347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35be6c4-51d2-492a-a121-67e72f19a717 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:10:48.709975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35be6c4-51d2-492a-a121-67e72f19a717 service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:48.710334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35be6c4-51d2-492a-a121-67e72f19a717 service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:48.710619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35be6c4-51d2-492a-a121-67e72f19a717 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:48.712665 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d35be6c4-51d2-492a-a121-67e72f19a717 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:48.728832 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35be6c4-51d2-492a-a121-67e72f19a717 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:10:48.730427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35be6c4-51d2-492a-a121-67e72f19a717 service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:10:48.743431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1206/2407] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:10:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:10:55.331060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3866-bec0-4f7b-b981-f46b0b63d5f4 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:10:55.331555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3866-bec0-4f7b-b981-f46b0b63d5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:10:55.331781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3866-bec0-4f7b-b981-f46b0b63d5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:10:55.355122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-8b0d3866-bec0-4f7b-b981-f46b0b63d5f4 None None] MFA Rules not processed for user `b04754683c9d4f9492f474fa30bea1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:10:55.357804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8b0d3866-bec0-4f7b-b981-f46b0b63d5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:10:55.365391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1202/2408] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:10:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:10:58.737903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=48 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:05.349061 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=44 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:06.789935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc7a8f-9184-4b7b-b9ce-b30496b5670c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:06.790452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc7a8f-9184-4b7b-b9ce-b30496b5670c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:06.790551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc7a8f-9184-4b7b-b9ce-b30496b5670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:06.808554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1edc7a8f-9184-4b7b-b9ce-b30496b5670c None None] MFA Rules not processed for user `06b8d18d37e7467f84841ec6ac0080fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:11:06.809782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1edc7a8f-9184-4b7b-b9ce-b30496b5670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:06.866377 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1207/2409] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:11:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:11:06.973951 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b0502-9e89-4b55-b429-6f9f84b7ea9f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:06.974835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b0502-9e89-4b55-b429-6f9f84b7ea9f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:06.975258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b0502-9e89-4b55-b429-6f9f84b7ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:06.999383 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d14b0502-9e89-4b55-b429-6f9f84b7ea9f None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:11:07.001061 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d14b0502-9e89-4b55-b429-6f9f84b7ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:07.014881 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1203/2410] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:11:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:11:07.031718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc7a8f-9184-4b7b-b9ce-b30496b5670c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:11:07.050538 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc7a8f-9184-4b7b-b9ce-b30496b5670c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:11:07.057962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db35dc5-deba-43af-ae95-bfa3b31cc2b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:11:07.059440 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db35dc5-deba-43af-ae95-bfa3b31cc2b9 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:07.059727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db35dc5-deba-43af-ae95-bfa3b31cc2b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:07.060007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db35dc5-deba-43af-ae95-bfa3b31cc2b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:07.071837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db35dc5-deba-43af-ae95-bfa3b31cc2b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:11:07.073709 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db35dc5-deba-43af-ae95-bfa3b31cc2b9 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:11:07.083837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1208/2411] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:11:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:11:16.990911 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:17.079733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=31 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:36.617505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8136f-170b-43fc-b582-1529e2224922 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:36.618082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8136f-170b-43fc-b582-1529e2224922 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:36.618082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8136f-170b-43fc-b582-1529e2224922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:36.637613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-53c8136f-170b-43fc-b582-1529e2224922 None None] MFA Rules not processed for user `7ca87844c7ef4b2da0a12915aeff81a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:11:36.639014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-53c8136f-170b-43fc-b582-1529e2224922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:36.645844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1204/2412] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:11:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:11:46.631090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:11:50.707124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290a647-d927-42dd-abc0-d6967c0da601 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:50.707689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290a647-d927-42dd-abc0-d6967c0da601 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:50.707843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290a647-d927-42dd-abc0-d6967c0da601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:50.726320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f290a647-d927-42dd-abc0-d6967c0da601 None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:11:50.727862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f290a647-d927-42dd-abc0-d6967c0da601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:50.735782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1209/2413] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:11:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:11:50.763627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8136f-170b-43fc-b582-1529e2224922 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:11:50.775598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8136f-170b-43fc-b582-1529e2224922 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:11:50.788081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d48aa8-793c-4878-949e-fc8bb428d248 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:11:50.788081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d48aa8-793c-4878-949e-fc8bb428d248 service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:50.788081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d48aa8-793c-4878-949e-fc8bb428d248 service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:50.788081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d48aa8-793c-4878-949e-fc8bb428d248 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:50.798955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d48aa8-793c-4878-949e-fc8bb428d248 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:11:50.802301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d48aa8-793c-4878-949e-fc8bb428d248 service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:11:50.823638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1205/2414] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:11:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:11:51.497967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba599a-1192-4770-a3a3-42c1d67f1bd4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:51.498266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba599a-1192-4770-a3a3-42c1d67f1bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:51.498545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba599a-1192-4770-a3a3-42c1d67f1bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:51.534354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1cba599a-1192-4770-a3a3-42c1d67f1bd4 None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:11:51.535679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1cba599a-1192-4770-a3a3-42c1d67f1bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:51.545501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1210/2415] 10.222.0.30 () {58 vars in 967 bytes} [Mon May 23 18:11:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:11:51.562226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d48aa8-793c-4878-949e-fc8bb428d248 service swift] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:11:51.589301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d48aa8-793c-4878-949e-fc8bb428d248 service swift] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:11:51.595539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2223a-c2f9-4b7f-9b81-dacb06289806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:11:51.604280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2223a-c2f9-4b7f-9b81-dacb06289806 service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:51.611186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2223a-c2f9-4b7f-9b81-dacb06289806 service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:51.611493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2223a-c2f9-4b7f-9b81-dacb06289806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:51.623894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2223a-c2f9-4b7f-9b81-dacb06289806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:11:51.625995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2223a-c2f9-4b7f-9b81-dacb06289806 service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:11:51.635323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1206/2416] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:11:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:11:51.845060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6e261-fd75-40c3-856d-d913919b95c6 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:51.845557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6e261-fd75-40c3-856d-d913919b95c6 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:51.845676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6e261-fd75-40c3-856d-d913919b95c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:51.863702 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-74e6e261-fd75-40c3-856d-d913919b95c6 None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:11:51.864884 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-74e6e261-fd75-40c3-856d-d913919b95c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:51.872388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1211/2417] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:11:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:11:51.885164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2223a-c2f9-4b7f-9b81-dacb06289806 service swift] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:11:51.896796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2223a-c2f9-4b7f-9b81-dacb06289806 service swift] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:11:51.904476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028bf12-0a36-4a36-9941-d0e087682c70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:11:51.905416 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bf12-0a36-4a36-9941-d0e087682c70 service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:51.905706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bf12-0a36-4a36-9941-d0e087682c70 service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:51.906048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bf12-0a36-4a36-9941-d0e087682c70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:51.915447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028bf12-0a36-4a36-9941-d0e087682c70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:11:51.917092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028bf12-0a36-4a36-9941-d0e087682c70 service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:11:51.926409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1207/2418] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:11:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:11:52.290512 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563b7b5-3f9d-4d56-8a4e-9893773905cf None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:52.299904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563b7b5-3f9d-4d56-8a4e-9893773905cf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:52.299904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563b7b5-3f9d-4d56-8a4e-9893773905cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:52.313148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e563b7b5-3f9d-4d56-8a4e-9893773905cf None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:11:52.314365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e563b7b5-3f9d-4d56-8a4e-9893773905cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:52.321599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1212/2419] 10.222.0.30 () {58 vars in 967 bytes} [Mon May 23 18:11:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:11:52.335052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028bf12-0a36-4a36-9941-d0e087682c70 service swift] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:11:52.347345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028bf12-0a36-4a36-9941-d0e087682c70 service swift] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:11:52.355086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5050-23cb-490c-b1f7-5e3f732844d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:11:52.356680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5050-23cb-490c-b1f7-5e3f732844d0 service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:52.357423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5050-23cb-490c-b1f7-5e3f732844d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:52.357788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5050-23cb-490c-b1f7-5e3f732844d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:52.366882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5050-23cb-490c-b1f7-5e3f732844d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:11:52.368549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5050-23cb-490c-b1f7-5e3f732844d0 service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:11:52.378476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1208/2420] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:11:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:11:57.790132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563b7b5-3f9d-4d56-8a4e-9893773905cf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:11:57.791563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e563b7b5-3f9d-4d56-8a4e-9893773905cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:57.805839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563b7b5-3f9d-4d56-8a4e-9893773905cf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:11:57.811360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:11:57.812309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:57.812589 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:57.812883 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] PATH_INFO: `/v3/users/2b641e57278c40faa5d20ea1ef7154bd` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:57.814067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b641e57278c40faa5d20ea1ef7154bd)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:11:57.816021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:11:57.865463 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b641e57278c40faa5d20ea1ef7154bd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:11:57.866107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b641e57278c40faa5d20ea1ef7154bd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:11:57.873923 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b641e57278c40faa5d20ea1ef7154bd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:11:57.874545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b641e57278c40faa5d20ea1ef7154bd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:11:57.886219 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b641e57278c40faa5d20ea1ef7154bd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:11:57.900103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1213/2421] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:11:57 2022] DELETE /identity/v3/users/2b641e57278c40faa5d20ea1ef7154bd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:11:57.904608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e462f82-4777-4401-a7a7-3e74121da46b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:57.905070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e462f82-4777-4401-a7a7-3e74121da46b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:57.905180 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e462f82-4777-4401-a7a7-3e74121da46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:57.923077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0e462f82-4777-4401-a7a7-3e74121da46b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:11:57.924311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0e462f82-4777-4401-a7a7-3e74121da46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:57.983018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1209/2422] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:11:57.992595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:11:57.994045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:58.059135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ae95-c989-4502-acd6-331c25b7a76b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:11:58.062618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213459e6-bb2f-4cda-bb1b-c6ff542a1ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:11:58.063311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213459e6-bb2f-4cda-bb1b-c6ff542a1ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:58.063596 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213459e6-bb2f-4cda-bb1b-c6ff542a1ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:58.063862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213459e6-bb2f-4cda-bb1b-c6ff542a1ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:58.073341 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213459e6-bb2f-4cda-bb1b-c6ff542a1ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:11:58.075682 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213459e6-bb2f-4cda-bb1b-c6ff542a1ef7 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:11:58.086185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1214/2423] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:11:58.292544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e462f82-4777-4401-a7a7-3e74121da46b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:11:58.294625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0e462f82-4777-4401-a7a7-3e74121da46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:11:58.306654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e462f82-4777-4401-a7a7-3e74121da46b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:11:58.312987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:11:58.313902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:11:58.314174 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:11:58.314453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] PATH_INFO: `/v3/projects/bfcac6234abb473aba962b7dc9e4a3c3` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:11:58.315731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcac6234abb473aba962b7dc9e4a3c3)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:11:58.317678 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:11:58.365757 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcac6234abb473aba962b7dc9e4a3c3', 'request_id': 'req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:11:58.374142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcac6234abb473aba962b7dc9e4a3c3', 'request_id': 'req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:11:58.380823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcac6234abb473aba962b7dc9e4a3c3', 'request_id': 'req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:11:58.392119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] The token cache is being invalidate because project bfcac6234abb473aba962b7dc9e4a3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:11:58.392413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:11:58.393078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:11:58.394661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1210/2424] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:11:58 2022] DELETE /identity/v3/projects/bfcac6234abb473aba962b7dc9e4a3c3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:12:08.081527 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=67,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:08.389102 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:14.171297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213459e6-bb2f-4cda-bb1b-c6ff542a1ef7 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:14.172952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-213459e6-bb2f-4cda-bb1b-c6ff542a1ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:14.192048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213459e6-bb2f-4cda-bb1b-c6ff542a1ef7 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:14.256344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a92766-7a93-4571-bc91-49b8bdb51517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:14.257540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a92766-7a93-4571-bc91-49b8bdb51517 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:14.258460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a92766-7a93-4571-bc91-49b8bdb51517 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:14.258770 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a92766-7a93-4571-bc91-49b8bdb51517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:14.260627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e0a92766-7a93-4571-bc91-49b8bdb51517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:14.330357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a92766-7a93-4571-bc91-49b8bdb51517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:14.332035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a92766-7a93-4571-bc91-49b8bdb51517 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:14.341661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1215/2425] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:12:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:12:15.481236 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:15.483110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:15.504420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b8ffe-c509-42e0-b6e6-2392caddb7e5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:15.513640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49acd1c-c2e8-4f90-9a62-01b8525535c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:15.514316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49acd1c-c2e8-4f90-9a62-01b8525535c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:15.514605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49acd1c-c2e8-4f90-9a62-01b8525535c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:15.514933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49acd1c-c2e8-4f90-9a62-01b8525535c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:15.516867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e49acd1c-c2e8-4f90-9a62-01b8525535c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:15.595079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49acd1c-c2e8-4f90-9a62-01b8525535c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:15.596499 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49acd1c-c2e8-4f90-9a62-01b8525535c9 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:15.607853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1211/2426] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:12:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:12:17.308488 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16637-bf92-4dbe-8828-619a7c95a6c0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:17.309017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16637-bf92-4dbe-8828-619a7c95a6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:17.309017 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16637-bf92-4dbe-8828-619a7c95a6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:17.330532 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-23d16637-bf92-4dbe-8828-619a7c95a6c0 None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:17.332458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-23d16637-bf92-4dbe-8828-619a7c95a6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:17.480403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1216/2427] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:12:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:12:17.493816 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49acd1c-c2e8-4f90-9a62-01b8525535c9 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:17.496472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e49acd1c-c2e8-4f90-9a62-01b8525535c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:17.635463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49acd1c-c2e8-4f90-9a62-01b8525535c9 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:17.655022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4de73-decc-40c1-bc3b-0f2fb2b6f810 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:17.655744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4de73-decc-40c1-bc3b-0f2fb2b6f810 service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:17.656034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4de73-decc-40c1-bc3b-0f2fb2b6f810 service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:17.656339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4de73-decc-40c1-bc3b-0f2fb2b6f810 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:17.668124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4de73-decc-40c1-bc3b-0f2fb2b6f810 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:17.669735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4de73-decc-40c1-bc3b-0f2fb2b6f810 service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:17.679294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1212/2428] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:12:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:12:23.491737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77966ab-6d7d-4154-b190-fedbe910304c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:23.492258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77966ab-6d7d-4154-b190-fedbe910304c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:23.492664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77966ab-6d7d-4154-b190-fedbe910304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:23.514005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b77966ab-6d7d-4154-b190-fedbe910304c None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:23.514947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b77966ab-6d7d-4154-b190-fedbe910304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:23.529298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1217/2429] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:12:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:12:23.592242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4de73-decc-40c1-bc3b-0f2fb2b6f810 service swift] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:23.608283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4de73-decc-40c1-bc3b-0f2fb2b6f810 service swift] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:23.617872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbd231-5339-403f-aea1-74a622b61060 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:23.619119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd231-5339-403f-aea1-74a622b61060 service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:23.619562 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd231-5339-403f-aea1-74a622b61060 service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:23.620231 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd231-5339-403f-aea1-74a622b61060 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:23.632310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbd231-5339-403f-aea1-74a622b61060 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:23.634264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbd231-5339-403f-aea1-74a622b61060 service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:23.647699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1213/2430] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:12:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:12:33.506479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=78 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:33.642506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=68 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:40.773348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e0ec4-2212-44c3-ba4e-a53a34992257 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:40.773935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e0ec4-2212-44c3-ba4e-a53a34992257 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:40.773935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e0ec4-2212-44c3-ba4e-a53a34992257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:40.794023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-223e0ec4-2212-44c3-ba4e-a53a34992257 None None] MFA Rules not processed for user `3bc1f574f2e84b47ad12c67641cc087c`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:40.795264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-223e0ec4-2212-44c3-ba4e-a53a34992257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:40.861649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1218/2431] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:12:41.083962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372572e-66c9-45ed-84cd-1ec2efb15898 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:41.084561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372572e-66c9-45ed-84cd-1ec2efb15898 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:41.084778 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372572e-66c9-45ed-84cd-1ec2efb15898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:41.106514 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f372572e-66c9-45ed-84cd-1ec2efb15898 None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:41.108061 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f372572e-66c9-45ed-84cd-1ec2efb15898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:41.116851 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1214/2432] 10.222.0.30 () {58 vars in 967 bytes} [Mon May 23 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:12:41.135109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e0ec4-2212-44c3-ba4e-a53a34992257 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:41.148324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e0ec4-2212-44c3-ba4e-a53a34992257 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:41.154043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95ed01-8bdf-4104-a7c0-eb1e59f55bf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:41.154876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95ed01-8bdf-4104-a7c0-eb1e59f55bf6 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:41.155147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95ed01-8bdf-4104-a7c0-eb1e59f55bf6 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:41.155432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95ed01-8bdf-4104-a7c0-eb1e59f55bf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:41.165056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95ed01-8bdf-4104-a7c0-eb1e59f55bf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:41.167410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95ed01-8bdf-4104-a7c0-eb1e59f55bf6 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:41.176902 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1219/2433] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:12:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:12:41.493638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372572e-66c9-45ed-84cd-1ec2efb15898 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:41.505223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372572e-66c9-45ed-84cd-1ec2efb15898 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:41.523340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b88c5-e498-4ba7-a118-1ac5be658434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:41.524124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b88c5-e498-4ba7-a118-1ac5be658434 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:41.524420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b88c5-e498-4ba7-a118-1ac5be658434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:41.524706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b88c5-e498-4ba7-a118-1ac5be658434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:41.528166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-082b88c5-e498-4ba7-a118-1ac5be658434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:41.609966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfec28-7d49-4a63-a61f-6c2e8b9da350 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:41.610410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfec28-7d49-4a63-a61f-6c2e8b9da350 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:41.611014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfec28-7d49-4a63-a61f-6c2e8b9da350 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:41.612982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1220/2434] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 18:12:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:12:41.627348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34571f74-d4c3-4193-9b44-90a6ff30fbfa None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:41.628495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34571f74-d4c3-4193-9b44-90a6ff30fbfa None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:41.628885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34571f74-d4c3-4193-9b44-90a6ff30fbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:41.680869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-34571f74-d4c3-4193-9b44-90a6ff30fbfa None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:41.682485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b88c5-e498-4ba7-a118-1ac5be658434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:41.683464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-34571f74-d4c3-4193-9b44-90a6ff30fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:41.684348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b88c5-e498-4ba7-a118-1ac5be658434 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:41.694515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1221/2435] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:12:41.708994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34571f74-d4c3-4193-9b44-90a6ff30fbfa None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:41.710416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-34571f74-d4c3-4193-9b44-90a6ff30fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:41.716691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1215/2436] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:12:41.805643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34571f74-d4c3-4193-9b44-90a6ff30fbfa None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:41.805643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aca0df-6f61-4761-9df0-1ab84e0e7f10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a5d7aee47e43e9904a93c6ce3bb412', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:41.805643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aca0df-6f61-4761-9df0-1ab84e0e7f10 service glance] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:41.805643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aca0df-6f61-4761-9df0-1ab84e0e7f10 service glance] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:41.807085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aca0df-6f61-4761-9df0-1ab84e0e7f10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:41.813961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aca0df-6f61-4761-9df0-1ab84e0e7f10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:41.815478 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aca0df-6f61-4761-9df0-1ab84e0e7f10 service glance] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:41.827408 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1222/2437] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:12:41.905129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b41e3-7900-4321-972b-6d04233239ea None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:41.905421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b41e3-7900-4321-972b-6d04233239ea None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:41.905694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b41e3-7900-4321-972b-6d04233239ea None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:41.907211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1216/2438] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 18:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 18:12:41.911956 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cb897-1d44-444d-8abd-3c780b0da338 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:41.912251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cb897-1d44-444d-8abd-3c780b0da338 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:41.912533 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cb897-1d44-444d-8abd-3c780b0da338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:41.933261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-dd2cb897-1d44-444d-8abd-3c780b0da338 None None] MFA Rules not processed for user `a26055489c284bcf8f0d418e4afffe73`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:41.934495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dd2cb897-1d44-444d-8abd-3c780b0da338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:41.941035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1223/2439] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:12:41.953379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b41e3-7900-4321-972b-6d04233239ea None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:41.955310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b16b41e3-7900-4321-972b-6d04233239ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:41.969495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b41e3-7900-4321-972b-6d04233239ea None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:41.973319 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba77a0-9904-4ff1-9092-c6a846610f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:41.973956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba77a0-9904-4ff1-9092-c6a846610f26 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:41.974308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba77a0-9904-4ff1-9092-c6a846610f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:41.974932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba77a0-9904-4ff1-9092-c6a846610f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:41.983941 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba77a0-9904-4ff1-9092-c6a846610f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:41.985444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba77a0-9904-4ff1-9092-c6a846610f26 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:41.993795 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1217/2440] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:12:42.089008 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63844114-2a67-4636-ae14-d1038847ac44 None None] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:42.089297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63844114-2a67-4636-ae14-d1038847ac44 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:42.089571 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63844114-2a67-4636-ae14-d1038847ac44 None None] PATH_INFO: `/` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:42.090997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1224/2441] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 18:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:12:42.096355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d45c31-9f04-4f65-8eb5-a77846d43546 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:42.096830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d45c31-9f04-4f65-8eb5-a77846d43546 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:42.096929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d45c31-9f04-4f65-8eb5-a77846d43546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:42.116642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-66d45c31-9f04-4f65-8eb5-a77846d43546 None None] MFA Rules not processed for user `9021e2249e11489083139e210562ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:42.117929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-66d45c31-9f04-4f65-8eb5-a77846d43546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:42.127583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1218/2442] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 18:12:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:12:42.138653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63844114-2a67-4636-ae14-d1038847ac44 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:42.151724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63844114-2a67-4636-ae14-d1038847ac44 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:42.156787 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dda900-09f9-49a8-981d-5039e39bba22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:42.157433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dda900-09f9-49a8-981d-5039e39bba22 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:42.157730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dda900-09f9-49a8-981d-5039e39bba22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:42.158003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dda900-09f9-49a8-981d-5039e39bba22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:42.170573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dda900-09f9-49a8-981d-5039e39bba22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:42.172125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dda900-09f9-49a8-981d-5039e39bba22 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:42.183485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1225/2443] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:12:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:12:43.495414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a8037-bebd-43bc-9fa7-0bc015c800cd None None] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:43.495984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a8037-bebd-43bc-9fa7-0bc015c800cd None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:43.496800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a8037-bebd-43bc-9fa7-0bc015c800cd None None] PATH_INFO: `/` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:43.498766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1219/2444] 10.222.0.30 () {54 vars in 921 bytes} [Mon May 23 18:12:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 18:12:43.527066 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886be16-dcb9-4b27-a346-c0ccd046bd59 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:43.527467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886be16-dcb9-4b27-a346-c0ccd046bd59 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:43.527694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886be16-dcb9-4b27-a346-c0ccd046bd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:43.575702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a8037-bebd-43bc-9fa7-0bc015c800cd None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:43.577488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b50a8037-bebd-43bc-9fa7-0bc015c800cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:43.589311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1886be16-dcb9-4b27-a346-c0ccd046bd59 None None] MFA Rules not processed for user `77e042a473204d358e3b0682bf1338d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:43.590569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1886be16-dcb9-4b27-a346-c0ccd046bd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:43.631564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:43.657628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1226/2445] 10.222.0.30 () {58 vars in 1018 bytes} [Mon May 23 18:12:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:12:43.663339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a8037-bebd-43bc-9fa7-0bc015c800cd None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:43.668627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:43.668879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886be16-dcb9-4b27-a346-c0ccd046bd59 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:43.669519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:43.669807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:43.670088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] PATH_INFO: `/v3/users/7ca87844c7ef4b2da0a12915aeff81a0` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:43.670190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1886be16-dcb9-4b27-a346-c0ccd046bd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:43.671335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca87844c7ef4b2da0a12915aeff81a0)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:43.673265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:43.683929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886be16-dcb9-4b27-a346-c0ccd046bd59 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:43.689578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e2b8-db70-403a-beac-f5f56a609b7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:43.690229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e2b8-db70-403a-beac-f5f56a609b7a service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:43.690517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e2b8-db70-403a-beac-f5f56a609b7a service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:43.690961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e2b8-db70-403a-beac-f5f56a609b7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:43.702378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038e2b8-db70-403a-beac-f5f56a609b7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:43.704048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038e2b8-db70-403a-beac-f5f56a609b7a service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:43.717556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1227/2446] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:12:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:12:43.729209 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca87844c7ef4b2da0a12915aeff81a0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:12:43.737298 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca87844c7ef4b2da0a12915aeff81a0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:12:43.738077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca87844c7ef4b2da0a12915aeff81a0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:12:43.738777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca87844c7ef4b2da0a12915aeff81a0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:12:43.744853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:43.756994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca87844c7ef4b2da0a12915aeff81a0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:12:43.771726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1220/2447] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:12:43 2022] DELETE /identity/v3/users/7ca87844c7ef4b2da0a12915aeff81a0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:12:43.968544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e2b8-db70-403a-beac-f5f56a609b7a service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:43.980755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e2b8-db70-403a-beac-f5f56a609b7a service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:44.064378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:44.065224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.065503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.065780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] PATH_INFO: `/v3/projects/c743c4e622a84f7e9a2bf858b3a164fe` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.067025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c743c4e622a84f7e9a2bf858b3a164fe)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:44.068921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:44.128267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c743c4e622a84f7e9a2bf858b3a164fe', 'request_id': 'req-70cda862-b5a8-4f2f-a847-6fafd885a196'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:12:44.135248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:44.136967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c743c4e622a84f7e9a2bf858b3a164fe', 'request_id': 'req-70cda862-b5a8-4f2f-a847-6fafd885a196'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:12:44.137117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:44.144426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c743c4e622a84f7e9a2bf858b3a164fe', 'request_id': 'req-70cda862-b5a8-4f2f-a847-6fafd885a196'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:12:44.159135 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] The token cache is being invalidate because project c743c4e622a84f7e9a2bf858b3a164fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:12:44.159434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:12:44.160084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-70cda862-b5a8-4f2f-a847-6fafd885a196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:12:44.165431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1228/2448] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:12:43 2022] DELETE /identity/v3/projects/c743c4e622a84f7e9a2bf858b3a164fe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:12:44.167842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f8cb7-1503-428b-acc9-6bf9c901e76b None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.167842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f8cb7-1503-428b-acc9-6bf9c901e76b None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.168029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f8cb7-1503-428b-acc9-6bf9c901e76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.188763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e24f8cb7-1503-428b-acc9-6bf9c901e76b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:44.190197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e24f8cb7-1503-428b-acc9-6bf9c901e76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:44.203152 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deae62-4b80-4b39-bd13-f6fb0fb55f69 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:44.245770 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:44.258510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d59345-777c-4b6d-9afd-40f9377e8be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:44.259482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d59345-777c-4b6d-9afd-40f9377e8be3 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.260104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d59345-777c-4b6d-9afd-40f9377e8be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.260238 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d59345-777c-4b6d-9afd-40f9377e8be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.262239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-53d59345-777c-4b6d-9afd-40f9377e8be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:44.279967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1229/2449] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:12:44.282091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5edd0d-0671-4e6f-b319-e072b7fa4373 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.282384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5edd0d-0671-4e6f-b319-e072b7fa4373 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.282663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5edd0d-0671-4e6f-b319-e072b7fa4373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.306042 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ad5edd0d-0671-4e6f-b319-e072b7fa4373 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:44.308073 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ad5edd0d-0671-4e6f-b319-e072b7fa4373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:44.318872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1230/2450] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:12:44.323253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5edd0d-0671-4e6f-b319-e072b7fa4373 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:44.334529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5edd0d-0671-4e6f-b319-e072b7fa4373 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:44.340857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889437a-ba68-4aec-a123-a2059c96ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:44.341343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889437a-ba68-4aec-a123-a2059c96ca35 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.341577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889437a-ba68-4aec-a123-a2059c96ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.341980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889437a-ba68-4aec-a123-a2059c96ca35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.342811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889437a-ba68-4aec-a123-a2059c96ca35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:12:44.343317 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889437a-ba68-4aec-a123-a2059c96ca35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:44.344745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889437a-ba68-4aec-a123-a2059c96ca35 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:44.359913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1231/2451] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:12:44.360786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d59345-777c-4b6d-9afd-40f9377e8be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:44.362223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d59345-777c-4b6d-9afd-40f9377e8be3 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:44.364137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889437a-ba68-4aec-a123-a2059c96ca35 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:44.378992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1221/2452] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:12:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:12:44.381028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889437a-ba68-4aec-a123-a2059c96ca35 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:44.387015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f092695-5166-48a7-b085-eec2c6dff4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:44.387901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092695-5166-48a7-b085-eec2c6dff4df admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.388272 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092695-5166-48a7-b085-eec2c6dff4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.388697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092695-5166-48a7-b085-eec2c6dff4df admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.389878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f092695-5166-48a7-b085-eec2c6dff4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:44.392236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f092695-5166-48a7-b085-eec2c6dff4df admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:44.434747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1232/2453] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:12:44 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:12:44.437649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d59345-777c-4b6d-9afd-40f9377e8be3 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:44.451315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d59345-777c-4b6d-9afd-40f9377e8be3 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:44.492715 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:44.530229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38894c6-7c03-47ee-bc88-1071df8a5932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:44.531717 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38894c6-7c03-47ee-bc88-1071df8a5932 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.531998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38894c6-7c03-47ee-bc88-1071df8a5932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.532275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38894c6-7c03-47ee-bc88-1071df8a5932 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.532985 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38894c6-7c03-47ee-bc88-1071df8a5932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:44.534936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38894c6-7c03-47ee-bc88-1071df8a5932 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:44.564679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1222/2454] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:12:44 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:12:44.570965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f092695-5166-48a7-b085-eec2c6dff4df admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:44.582134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f092695-5166-48a7-b085-eec2c6dff4df admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:44.586945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0978d-fbe4-434b-8acf-da11ce0371ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:44.587717 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0978d-fbe4-434b-8acf-da11ce0371ce admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.588267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0978d-fbe4-434b-8acf-da11ce0371ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.588780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0978d-fbe4-434b-8acf-da11ce0371ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.589510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0978d-fbe4-434b-8acf-da11ce0371ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:44.591143 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0978d-fbe4-434b-8acf-da11ce0371ce admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:44.602224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1233/2455] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:12:44.606441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38894c6-7c03-47ee-bc88-1071df8a5932 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:44.616949 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38894c6-7c03-47ee-bc88-1071df8a5932 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:44.622581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b1fd9-4882-4554-84a4-b4e37b6260a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:44.623559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1fd9-4882-4554-84a4-b4e37b6260a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.623907 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1fd9-4882-4554-84a4-b4e37b6260a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.624251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1fd9-4882-4554-84a4-b4e37b6260a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.625055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b1fd9-4882-4554-84a4-b4e37b6260a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:44.626838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b1fd9-4882-4554-84a4-b4e37b6260a1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:44.638513 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1223/2456] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:12:44.643236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0978d-fbe4-434b-8acf-da11ce0371ce admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:44.655975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0978d-fbe4-434b-8acf-da11ce0371ce admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:44.662352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ba7e-5ffe-4672-bd6f-dc4ae567e68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:44.663278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ba7e-5ffe-4672-bd6f-dc4ae567e68d admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.663561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ba7e-5ffe-4672-bd6f-dc4ae567e68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.663836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ba7e-5ffe-4672-bd6f-dc4ae567e68d admin admin] PATH_INFO: `/v3/projects/a12053b619da4281af2bb84c39adace1/users/ec942687c3b54d35b144d87bcce30966/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.681012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6ba7e-5ffe-4672-bd6f-dc4ae567e68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12053b619da4281af2bb84c39adace1, user_id=ec942687c3b54d35b144d87bcce30966, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:44.683836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6ba7e-5ffe-4672-bd6f-dc4ae567e68d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:44.698266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1234/2457] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:12:44 2022] PUT /identity/v3/projects/a12053b619da4281af2bb84c39adace1/users/ec942687c3b54d35b144d87bcce30966/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:12:44.709018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f764-db69-4790-b6ac-ada90f66edd9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.709303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f764-db69-4790-b6ac-ada90f66edd9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.709580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f764-db69-4790-b6ac-ada90f66edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.737258 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d2c4f764-db69-4790-b6ac-ada90f66edd9 None None] MFA Rules not processed for user `ec942687c3b54d35b144d87bcce30966`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:44.738456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d2c4f764-db69-4790-b6ac-ada90f66edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:44.811049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1224/2458] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:12:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:12:44.821540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ba7e-5ffe-4672-bd6f-dc4ae567e68d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:44.823510 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3fa6ba7e-5ffe-4672-bd6f-dc4ae567e68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:44.881782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ba7e-5ffe-4672-bd6f-dc4ae567e68d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:44.885525 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167d6e1-021d-49c9-92ad-66fb11cac350 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a5d7aee47e43e9904a93c6ce3bb412', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:44.886172 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167d6e1-021d-49c9-92ad-66fb11cac350 service glance] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:44.886459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167d6e1-021d-49c9-92ad-66fb11cac350 service glance] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:44.886772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167d6e1-021d-49c9-92ad-66fb11cac350 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:44.895792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167d6e1-021d-49c9-92ad-66fb11cac350 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:44.897229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167d6e1-021d-49c9-92ad-66fb11cac350 service glance] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:44.906249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1235/2459] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:12:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:12:48.280768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076802c-56cc-4ff5-9841-1805edec933f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:48.281593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076802c-56cc-4ff5-9841-1805edec933f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:48.282019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076802c-56cc-4ff5-9841-1805edec933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:48.302839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2076802c-56cc-4ff5-9841-1805edec933f None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:12:48.304055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2076802c-56cc-4ff5-9841-1805edec933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:48.368869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1225/2460] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:12:48.381001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167d6e1-021d-49c9-92ad-66fb11cac350 service glance] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:48.382623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a167d6e1-021d-49c9-92ad-66fb11cac350 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:48.460345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167d6e1-021d-49c9-92ad-66fb11cac350 service glance] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:48.466874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7a16-3189-4043-897e-e6a3c4551e01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:48.467482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7a16-3189-4043-897e-e6a3c4551e01 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:48.467768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7a16-3189-4043-897e-e6a3c4551e01 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:48.468046 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7a16-3189-4043-897e-e6a3c4551e01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:48.476982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f7a16-3189-4043-897e-e6a3c4551e01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:48.478574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f7a16-3189-4043-897e-e6a3c4551e01 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:48.487729 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1236/2461] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:12:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:12:57.805192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076802c-56cc-4ff5-9841-1805edec933f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:12:57.806649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2076802c-56cc-4ff5-9841-1805edec933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:57.861552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:12:57.890955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076802c-56cc-4ff5-9841-1805edec933f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:12:57.896819 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bb61d-01b6-4742-b729-53f674bfd63c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:12:57.897463 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bb61d-01b6-4742-b729-53f674bfd63c service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:12:57.897808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bb61d-01b6-4742-b729-53f674bfd63c service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:12:57.898021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bb61d-01b6-4742-b729-53f674bfd63c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:12:57.899866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3f8bb61d-01b6-4742-b729-53f674bfd63c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:12:57.958079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bb61d-01b6-4742-b729-53f674bfd63c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:12:57.959718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bb61d-01b6-4742-b729-53f674bfd63c service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:12:57.970286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1226/2462] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:12:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:12:58.484402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:07.966270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=34 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:16.598751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7a16-3189-4043-897e-e6a3c4551e01 service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:13:16.599803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bb61d-01b6-4742-b729-53f674bfd63c service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:13:16.600275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-558f7a16-3189-4043-897e-e6a3c4551e01 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:16.601332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3f8bb61d-01b6-4742-b729-53f674bfd63c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:16.661182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7a16-3189-4043-897e-e6a3c4551e01 service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:13:16.663250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bb61d-01b6-4742-b729-53f674bfd63c service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:13:16.664728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477ef19-18be-4bff-84c4-7a1d013306c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:13:16.665367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ef19-18be-4bff-84c4-7a1d013306c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:13:16.666339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ef19-18be-4bff-84c4-7a1d013306c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:13:16.666618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ef19-18be-4bff-84c4-7a1d013306c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:13:16.667532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62729928-1d9f-4e97-aa92-5b3c28d03e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:13:16.668174 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62729928-1d9f-4e97-aa92-5b3c28d03e9c service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:13:16.668409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5477ef19-18be-4bff-84c4-7a1d013306c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:16.668517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62729928-1d9f-4e97-aa92-5b3c28d03e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:13:16.668727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62729928-1d9f-4e97-aa92-5b3c28d03e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:13:16.670640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-62729928-1d9f-4e97-aa92-5b3c28d03e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:16.678769 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ef19-18be-4bff-84c4-7a1d013306c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:13:16.680239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62729928-1d9f-4e97-aa92-5b3c28d03e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:13:16.680367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ef19-18be-4bff-84c4-7a1d013306c3 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:13:16.682370 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62729928-1d9f-4e97-aa92-5b3c28d03e9c service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:13:16.690220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1237/2463] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:13:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:13:16.690750 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1227/2464] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:13:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:13:26.685610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=26 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:26.686888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=26 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:38.846978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477ef19-18be-4bff-84c4-7a1d013306c3 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:13:38.848764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5477ef19-18be-4bff-84c4-7a1d013306c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:38.865351 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477ef19-18be-4bff-84c4-7a1d013306c3 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:13:38.870617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eade684-dace-4819-95c4-360a9e79d931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:13:38.871345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eade684-dace-4819-95c4-360a9e79d931 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:13:38.871627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eade684-dace-4819-95c4-360a9e79d931 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:13:38.871900 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eade684-dace-4819-95c4-360a9e79d931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:13:38.873734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4eade684-dace-4819-95c4-360a9e79d931 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:38.885771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eade684-dace-4819-95c4-360a9e79d931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:13:38.887869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eade684-dace-4819-95c4-360a9e79d931 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:13:38.898345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1238/2465] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:13:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:13:48.893857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:51.666301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324057-7b7a-4be2-aa2b-e0fb0b29481f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:13:51.666929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324057-7b7a-4be2-aa2b-e0fb0b29481f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:13:51.666929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d324057-7b7a-4be2-aa2b-e0fb0b29481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:13:51.686218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3d324057-7b7a-4be2-aa2b-e0fb0b29481f None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:13:51.687462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3d324057-7b7a-4be2-aa2b-e0fb0b29481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:51.694884 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1228/2466] 10.222.0.30 () {58 vars in 967 bytes} [Mon May 23 18:13:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:13:51.737998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eade684-dace-4819-95c4-360a9e79d931 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:13:51.750646 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eade684-dace-4819-95c4-360a9e79d931 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:13:51.756074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce685775-1fe2-4edd-bdb4-cd05d72a781e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:13:51.756727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce685775-1fe2-4edd-bdb4-cd05d72a781e service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:13:51.757008 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce685775-1fe2-4edd-bdb4-cd05d72a781e service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:13:51.757282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce685775-1fe2-4edd-bdb4-cd05d72a781e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:13:51.766917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce685775-1fe2-4edd-bdb4-cd05d72a781e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:13:51.768503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce685775-1fe2-4edd-bdb4-cd05d72a781e service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:13:51.780028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1239/2467] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:13:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:13:53.237021 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324057-7b7a-4be2-aa2b-e0fb0b29481f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:13:53.317483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d324057-7b7a-4be2-aa2b-e0fb0b29481f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:13:53.322081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:13:53.322989 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:13:53.323874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:13:53.324147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] PATH_INFO: `/v3/users/ec942687c3b54d35b144d87bcce30966` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:13:53.325371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec942687c3b54d35b144d87bcce30966)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:13:53.327560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:13:53.376746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec942687c3b54d35b144d87bcce30966'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:13:53.384354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec942687c3b54d35b144d87bcce30966'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:13:53.385062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec942687c3b54d35b144d87bcce30966'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:13:53.385762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec942687c3b54d35b144d87bcce30966'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:13:53.399766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec942687c3b54d35b144d87bcce30966'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:13:53.413717 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1229/2468] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:13:53 2022] DELETE /identity/v3/users/ec942687c3b54d35b144d87bcce30966 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:13:53.418395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3536-9f4a-4ad3-b69b-7a63ac2df5f8 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:13:53.418878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3536-9f4a-4ad3-b69b-7a63ac2df5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:13:53.418993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3536-9f4a-4ad3-b69b-7a63ac2df5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:13:53.437927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-37ec3536-9f4a-4ad3-b69b-7a63ac2df5f8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:13:53.439164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-37ec3536-9f4a-4ad3-b69b-7a63ac2df5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:53.499405 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1240/2469] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:13:53.510450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:13:53.512264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:53.569601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68707e-1763-4e83-b11b-651b174d0528 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:13:53.573242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942d9d-7a47-4597-b031-66fd631373d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:13:53.574211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942d9d-7a47-4597-b031-66fd631373d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:13:53.574494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942d9d-7a47-4597-b031-66fd631373d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:13:53.574797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942d9d-7a47-4597-b031-66fd631373d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:13:53.583648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb942d9d-7a47-4597-b031-66fd631373d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:13:53.585065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb942d9d-7a47-4597-b031-66fd631373d0 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:13:53.594563 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1230/2470] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:13:53.862498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec3536-9f4a-4ad3-b69b-7a63ac2df5f8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:13:53.863952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-37ec3536-9f4a-4ad3-b69b-7a63ac2df5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:53.877967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec3536-9f4a-4ad3-b69b-7a63ac2df5f8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:13:53.883213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:13:53.884104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:13:53.884441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:13:53.884725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] PATH_INFO: `/v3/projects/a12053b619da4281af2bb84c39adace1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:13:53.886500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12053b619da4281af2bb84c39adace1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:13:53.888893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:13:53.938778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12053b619da4281af2bb84c39adace1', 'request_id': 'req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:13:53.946101 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12053b619da4281af2bb84c39adace1', 'request_id': 'req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:13:53.953136 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12053b619da4281af2bb84c39adace1', 'request_id': 'req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:13:53.964352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] The token cache is being invalidate because project a12053b619da4281af2bb84c39adace1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:13:53.964705 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:13:53.965332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:13:53.966896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1241/2471] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:13:53 2022] DELETE /identity/v3/projects/a12053b619da4281af2bb84c39adace1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:13:59.447562 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942d9d-7a47-4597-b031-66fd631373d0 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:13:59.450150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-cb942d9d-7a47-4597-b031-66fd631373d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:59.471195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:13:59.546910 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942d9d-7a47-4597-b031-66fd631373d0 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:13:59.612897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0de7a4-898b-4b28-be62-3a05f5402321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:13:59.613539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0de7a4-898b-4b28-be62-3a05f5402321 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:13:59.613819 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0de7a4-898b-4b28-be62-3a05f5402321 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:13:59.614088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0de7a4-898b-4b28-be62-3a05f5402321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:13:59.615866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2d0de7a4-898b-4b28-be62-3a05f5402321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:13:59.627571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0de7a4-898b-4b28-be62-3a05f5402321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:13:59.629394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0de7a4-898b-4b28-be62-3a05f5402321 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:13:59.640328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1231/2472] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:13:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:14:03.961039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:09.637280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=55 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:27.184656 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:14:27.186101 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:14:27.250271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef50d5-cc0b-4c80-aed6-7b5be029b47e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:14:27.255066 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:14:27.255930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:14:27.256210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:14:27.256485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] PATH_INFO: `/v3/users/3bc1f574f2e84b47ad12c67641cc087c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:14:27.257671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc1f574f2e84b47ad12c67641cc087c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:14:27.260234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:14:27.307481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc1f574f2e84b47ad12c67641cc087c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:14:27.308154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc1f574f2e84b47ad12c67641cc087c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:14:27.315074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc1f574f2e84b47ad12c67641cc087c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:14:27.315633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc1f574f2e84b47ad12c67641cc087c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:14:27.327959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc1f574f2e84b47ad12c67641cc087c'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:14:27.340727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1242/2473] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:14:27 2022] DELETE /identity/v3/users/3bc1f574f2e84b47ad12c67641cc087c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:14:27.510542 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0de7a4-898b-4b28-be62-3a05f5402321 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:14:27.524468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0de7a4-898b-4b28-be62-3a05f5402321 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:14:27.582525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:14:27.583326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:14:27.583601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:14:27.583873 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] PATH_INFO: `/v3/projects/eefd7a6998d24e0189ed1c54dc911737` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:14:27.585029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefd7a6998d24e0189ed1c54dc911737)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:14:27.586944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:14:27.632351 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefd7a6998d24e0189ed1c54dc911737', 'request_id': 'req-018594c5-39db-4acc-a9f3-8fe99ce3c61c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:14:27.639414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefd7a6998d24e0189ed1c54dc911737', 'request_id': 'req-018594c5-39db-4acc-a9f3-8fe99ce3c61c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:14:27.645368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefd7a6998d24e0189ed1c54dc911737', 'request_id': 'req-018594c5-39db-4acc-a9f3-8fe99ce3c61c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:14:27.655904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] The token cache is being invalidate because project eefd7a6998d24e0189ed1c54dc911737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:14:27.656185 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:14:27.656796 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:14:27.658397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1232/2474] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:14:27 2022] DELETE /identity/v3/projects/eefd7a6998d24e0189ed1c54dc911737 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:14:37.336747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:37.652979 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:38.284131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:14:38.285890 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:14:38.360746 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa07ac-bc84-4c04-a15c-174128392bda admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:14:38.425431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3212306-3bc7-475b-bf7a-c68cacc207a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:14:38.426189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3212306-3bc7-475b-bf7a-c68cacc207a5 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:14:38.426473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3212306-3bc7-475b-bf7a-c68cacc207a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:14:38.426779 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3212306-3bc7-475b-bf7a-c68cacc207a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:14:38.428532 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c3212306-3bc7-475b-bf7a-c68cacc207a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:14:38.485845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3212306-3bc7-475b-bf7a-c68cacc207a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:14:38.487490 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3212306-3bc7-475b-bf7a-c68cacc207a5 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:14:38.497080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1243/2475] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:14:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:14:40.423933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:14:40.425379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:14:40.441170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018594c5-39db-4acc-a9f3-8fe99ce3c61c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:14:40.446532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dd45c-7b8a-4d7c-b207-3a17f93809f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:14:40.447202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dd45c-7b8a-4d7c-b207-3a17f93809f7 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:14:40.447482 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dd45c-7b8a-4d7c-b207-3a17f93809f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:14:40.447752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dd45c-7b8a-4d7c-b207-3a17f93809f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:14:40.450169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f62dd45c-7b8a-4d7c-b207-3a17f93809f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:14:40.507422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dd45c-7b8a-4d7c-b207-3a17f93809f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:14:40.509009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dd45c-7b8a-4d7c-b207-3a17f93809f7 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:14:40.519298 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1233/2476] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:14:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:14:48.492170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=84 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:14:50.514661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=28 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:06.201716 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3212306-3bc7-475b-bf7a-c68cacc207a5 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:15:06.215753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3212306-3bc7-475b-bf7a-c68cacc207a5 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:15:06.225194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a83da-596f-4657-95b3-a2dada648001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:15:06.226456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a83da-596f-4657-95b3-a2dada648001 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:15:06.227060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a83da-596f-4657-95b3-a2dada648001 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:15:06.227745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a83da-596f-4657-95b3-a2dada648001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:15:06.231194 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a28a83da-596f-4657-95b3-a2dada648001 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:06.248350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a83da-596f-4657-95b3-a2dada648001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:15:06.250979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a83da-596f-4657-95b3-a2dada648001 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:15:06.271775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1244/2477] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:15:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:15:08.893869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92211b8a-418a-4f15-ab9f-b7ec704a46d7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:15:08.894411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92211b8a-418a-4f15-ab9f-b7ec704a46d7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:15:08.894411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92211b8a-418a-4f15-ab9f-b7ec704a46d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:15:08.913318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-92211b8a-418a-4f15-ab9f-b7ec704a46d7 None None] MFA Rules not processed for user `32e9879d092b4c819f1f5607f42cc364`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:15:08.914508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-92211b8a-418a-4f15-ab9f-b7ec704a46d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:08.972467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1234/2478] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:15:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:15:09.322861 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a83da-596f-4657-95b3-a2dada648001 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:15:09.324979 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a28a83da-596f-4657-95b3-a2dada648001 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:09.398107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a83da-596f-4657-95b3-a2dada648001 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:15:09.402485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad30fb-8f9d-41ab-bb52-94ed5930103d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:15:09.403350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad30fb-8f9d-41ab-bb52-94ed5930103d service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:15:09.403677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad30fb-8f9d-41ab-bb52-94ed5930103d service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:15:09.404020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad30fb-8f9d-41ab-bb52-94ed5930103d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:15:09.405834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-19ad30fb-8f9d-41ab-bb52-94ed5930103d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:09.415792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad30fb-8f9d-41ab-bb52-94ed5930103d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:15:09.417242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad30fb-8f9d-41ab-bb52-94ed5930103d service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:15:09.426063 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1245/2479] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:15:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:15:09.805174 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92211b8a-418a-4f15-ab9f-b7ec704a46d7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:15:09.806800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-92211b8a-418a-4f15-ab9f-b7ec704a46d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:09.880335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92211b8a-418a-4f15-ab9f-b7ec704a46d7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:15:09.885291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc347aa-7ec5-4915-bf0a-5dc5b6ffd6c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:15:09.885929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc347aa-7ec5-4915-bf0a-5dc5b6ffd6c9 service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:15:09.886208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc347aa-7ec5-4915-bf0a-5dc5b6ffd6c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:15:09.886560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc347aa-7ec5-4915-bf0a-5dc5b6ffd6c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:15:09.888301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9bc347aa-7ec5-4915-bf0a-5dc5b6ffd6c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:09.899396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc347aa-7ec5-4915-bf0a-5dc5b6ffd6c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:15:09.900953 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc347aa-7ec5-4915-bf0a-5dc5b6ffd6c9 service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:15:09.911817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1235/2480] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:15:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:15:11.950122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f79fda-0e37-45f0-aba9-31c38ac8192d None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:15:11.950684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f79fda-0e37-45f0-aba9-31c38ac8192d None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:15:11.950684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f79fda-0e37-45f0-aba9-31c38ac8192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:15:11.969330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b5f79fda-0e37-45f0-aba9-31c38ac8192d None None] MFA Rules not processed for user `a57822c1558143d38ad17326a742c370`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:15:11.970470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b5f79fda-0e37-45f0-aba9-31c38ac8192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:11.982583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1246/2481] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:15:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:15:19.907283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=57 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:21.962594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=35 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:40.158545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc347aa-7ec5-4915-bf0a-5dc5b6ffd6c9 service placement] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:15:40.160633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9bc347aa-7ec5-4915-bf0a-5dc5b6ffd6c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:40.175471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc347aa-7ec5-4915-bf0a-5dc5b6ffd6c9 service placement] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:15:40.180852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7e7fb-e542-4376-bf20-da4a21e90dae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:15:40.181476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7e7fb-e542-4376-bf20-da4a21e90dae service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:15:40.181754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7e7fb-e542-4376-bf20-da4a21e90dae service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:15:40.182664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7e7fb-e542-4376-bf20-da4a21e90dae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:15:40.184397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-96a7e7fb-e542-4376-bf20-da4a21e90dae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:40.241075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7e7fb-e542-4376-bf20-da4a21e90dae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:15:40.242954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7e7fb-e542-4376-bf20-da4a21e90dae service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:15:40.253022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1236/2482] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:15:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:15:43.932981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba4f0b-0702-4f9a-90d0-faaeb07d5778 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:15:43.933833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba4f0b-0702-4f9a-90d0-faaeb07d5778 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:15:43.934112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba4f0b-0702-4f9a-90d0-faaeb07d5778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:15:43.952852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-44ba4f0b-0702-4f9a-90d0-faaeb07d5778 None None] MFA Rules not processed for user `06b8d18d37e7467f84841ec6ac0080fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:15:43.954052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-44ba4f0b-0702-4f9a-90d0-faaeb07d5778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:43.960938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1247/2483] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:15:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:15:50.248653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=28 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:53.947434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:15:55.226247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7e7fb-e542-4376-bf20-da4a21e90dae service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:15:55.227790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-96a7e7fb-e542-4376-bf20-da4a21e90dae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:55.242829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7e7fb-e542-4376-bf20-da4a21e90dae service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:15:55.248406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9dd1-0d16-4c31-ad29-f9f6bd40fb38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:15:55.249079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9dd1-0d16-4c31-ad29-f9f6bd40fb38 service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:15:55.249372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9dd1-0d16-4c31-ad29-f9f6bd40fb38 service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:15:55.249650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9dd1-0d16-4c31-ad29-f9f6bd40fb38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:15:55.251430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f84c9dd1-0d16-4c31-ad29-f9f6bd40fb38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:15:55.263991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9dd1-0d16-4c31-ad29-f9f6bd40fb38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:15:55.265565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9dd1-0d16-4c31-ad29-f9f6bd40fb38 service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:15:55.275787 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1237/2484] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:05.271333 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=6 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:09.438436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba4f0b-0702-4f9a-90d0-faaeb07d5778 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:09.451958 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba4f0b-0702-4f9a-90d0-faaeb07d5778 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:09.457406 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934cd5b-99fa-4658-a9be-f535ee3b0240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:09.458045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934cd5b-99fa-4658-a9be-f535ee3b0240 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:09.458333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934cd5b-99fa-4658-a9be-f535ee3b0240 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:09.458609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934cd5b-99fa-4658-a9be-f535ee3b0240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:09.460390 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6934cd5b-99fa-4658-a9be-f535ee3b0240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:09.518163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934cd5b-99fa-4658-a9be-f535ee3b0240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:09.519784 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934cd5b-99fa-4658-a9be-f535ee3b0240 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:09.529393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1248/2485] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:18.952712 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6e040-c339-46d9-9fa8-48f47f1226cb None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:18.953213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6e040-c339-46d9-9fa8-48f47f1226cb None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:18.953404 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6e040-c339-46d9-9fa8-48f47f1226cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:18.973111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bea6e040-c339-46d9-9fa8-48f47f1226cb None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:18.974308 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bea6e040-c339-46d9-9fa8-48f47f1226cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:19.034044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1238/2486] 10.222.0.30 () {58 vars in 967 bytes} [Mon May 23 18:16:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:19.089055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934cd5b-99fa-4658-a9be-f535ee3b0240 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:19.090477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6934cd5b-99fa-4658-a9be-f535ee3b0240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:19.166905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934cd5b-99fa-4658-a9be-f535ee3b0240 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:19.171990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e8395-9436-487d-8939-47b88fb46b75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:19.172643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e8395-9436-487d-8939-47b88fb46b75 service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:19.172912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e8395-9436-487d-8939-47b88fb46b75 service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:19.173188 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e8395-9436-487d-8939-47b88fb46b75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:19.182892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e8395-9436-487d-8939-47b88fb46b75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:19.184509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e8395-9436-487d-8939-47b88fb46b75 service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:19.194114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1249/2487] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:16:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 18:16:19.545918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6e040-c339-46d9-9fa8-48f47f1226cb None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:19.556456 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6e040-c339-46d9-9fa8-48f47f1226cb None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:19.560101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecb22c-55ad-4a4c-8fc7-3688987cb8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:19.560815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecb22c-55ad-4a4c-8fc7-3688987cb8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:19.561167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecb22c-55ad-4a4c-8fc7-3688987cb8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:19.561512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecb22c-55ad-4a4c-8fc7-3688987cb8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:19.563503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1aecb22c-55ad-4a4c-8fc7-3688987cb8d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:19.632035 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecb22c-55ad-4a4c-8fc7-3688987cb8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:19.633530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecb22c-55ad-4a4c-8fc7-3688987cb8d8 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:19.644089 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1239/2488] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:21.479640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd5aed-53a8-49c8-8522-c629e97c001e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:21.480148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd5aed-53a8-49c8-8522-c629e97c001e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:21.480285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd5aed-53a8-49c8-8522-c629e97c001e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:21.498479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-6abd5aed-53a8-49c8-8522-c629e97c001e None None] MFA Rules not processed for user `8d08ba344a9349d99de16520d3ce5150`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:21.499666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6abd5aed-53a8-49c8-8522-c629e97c001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:21.508448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1250/2489] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:16:21.845396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecb22c-55ad-4a4c-8fc7-3688987cb8d8 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:21.846893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1aecb22c-55ad-4a4c-8fc7-3688987cb8d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:21.858031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecb22c-55ad-4a4c-8fc7-3688987cb8d8 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:21.861548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c0dbc-5d66-4809-b33d-b4bd53dc3392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:21.862189 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c0dbc-5d66-4809-b33d-b4bd53dc3392 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:21.862473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c0dbc-5d66-4809-b33d-b4bd53dc3392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:21.862800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c0dbc-5d66-4809-b33d-b4bd53dc3392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:21.864515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8a3c0dbc-5d66-4809-b33d-b4bd53dc3392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:21.874623 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c0dbc-5d66-4809-b33d-b4bd53dc3392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:21.876085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c0dbc-5d66-4809-b33d-b4bd53dc3392 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:21.884992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1240/2490] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:27.594725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd5aed-53a8-49c8-8522-c629e97c001e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:27.596303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6abd5aed-53a8-49c8-8522-c629e97c001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:27.612328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd5aed-53a8-49c8-8522-c629e97c001e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:27.617254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:27.618720 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:27.619198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:27.619480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] PATH_INFO: `/v3/users/b04754683c9d4f9492f474fa30bea1c2` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:27.620684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04754683c9d4f9492f474fa30bea1c2)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:27.622602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:27.668704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04754683c9d4f9492f474fa30bea1c2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:27.669344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04754683c9d4f9492f474fa30bea1c2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:27.676222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04754683c9d4f9492f474fa30bea1c2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:27.677059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04754683c9d4f9492f474fa30bea1c2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:27.689749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04754683c9d4f9492f474fa30bea1c2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:27.692304 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:27.705200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1251/2491] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:16:27 2022] DELETE /identity/v3/users/b04754683c9d4f9492f474fa30bea1c2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:16:27.882408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c0dbc-5d66-4809-b33d-b4bd53dc3392 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:27.894691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c0dbc-5d66-4809-b33d-b4bd53dc3392 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:27.966566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:27.967681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:27.968143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:27.968593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] PATH_INFO: `/v3/projects/f7e38224b6a74df8b5e931ccda46d3fd` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:27.969780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e38224b6a74df8b5e931ccda46d3fd)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:27.971724 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:28.010445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:28.032339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e38224b6a74df8b5e931ccda46d3fd', 'request_id': 'req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.041073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e38224b6a74df8b5e931ccda46d3fd', 'request_id': 'req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.049835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e38224b6a74df8b5e931ccda46d3fd', 'request_id': 'req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.063522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] The token cache is being invalidate because project f7e38224b6a74df8b5e931ccda46d3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:28.063866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.064867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.066422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1241/2492] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:27 2022] DELETE /identity/v3/projects/f7e38224b6a74df8b5e931ccda46d3fd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:28.071474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:28.073131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:28.087153 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51276de-bcc6-43d0-b190-442f6661e53f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:28.175534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:28.177104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:28.177455 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:28.177797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] PATH_INFO: `/v3/users/4be0f555ad2043b681a622f23d1ee1a3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:28.179534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be0f555ad2043b681a622f23d1ee1a3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:28.183119 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:28.264003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be0f555ad2043b681a622f23d1ee1a3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.264668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be0f555ad2043b681a622f23d1ee1a3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.282031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be0f555ad2043b681a622f23d1ee1a3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.283748 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be0f555ad2043b681a622f23d1ee1a3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.301093 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be0f555ad2043b681a622f23d1ee1a3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.321633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1252/2493] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:16:28 2022] DELETE /identity/v3/users/4be0f555ad2043b681a622f23d1ee1a3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:16:28.496805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:28.498245 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:28.512285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ed08f-6f9a-4602-b71c-f2cef4c41ce0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:28.578498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:28.579301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:28.579780 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:28.580052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] PATH_INFO: `/v3/projects/4cb2b48c293043a2aaac072c264302de` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:28.581247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb2b48c293043a2aaac072c264302de)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:28.583397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:28.632183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb2b48c293043a2aaac072c264302de', 'request_id': 'req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.639663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb2b48c293043a2aaac072c264302de', 'request_id': 'req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.646220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb2b48c293043a2aaac072c264302de', 'request_id': 'req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.657536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] The token cache is being invalidate because project 4cb2b48c293043a2aaac072c264302de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:28.657818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.658472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:28.660043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1242/2494] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:28 2022] DELETE /identity/v3/projects/4cb2b48c293043a2aaac072c264302de => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:38.317229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=11,keystone:SELECT=55,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:38.654518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:42.321954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:42.323711 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:42.384783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e113d5-7001-4c3b-96b2-68816984408b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:42.433407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8108b9-7841-47d1-a6f8-e7a32261262f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:42.434048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8108b9-7841-47d1-a6f8-e7a32261262f service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:42.434329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8108b9-7841-47d1-a6f8-e7a32261262f service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:42.434601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8108b9-7841-47d1-a6f8-e7a32261262f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:42.436453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fc8108b9-7841-47d1-a6f8-e7a32261262f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:42.497358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8108b9-7841-47d1-a6f8-e7a32261262f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:42.498819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8108b9-7841-47d1-a6f8-e7a32261262f service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:42.508618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1253/2495] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:45.379477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:45.380947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:45.397133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e2e21-5c06-4dbb-a5a7-5707a582a3aa admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:45.402025 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:45.402926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:45.403210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:45.403487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] PATH_INFO: `/v3/users/a57822c1558143d38ad17326a742c370` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:45.404654 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57822c1558143d38ad17326a742c370)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:45.406573 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:45.460186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57822c1558143d38ad17326a742c370'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:45.467106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57822c1558143d38ad17326a742c370'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:45.467789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57822c1558143d38ad17326a742c370'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:45.468394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57822c1558143d38ad17326a742c370'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:45.480702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c81c9cf9-6b9d-4212-9581-42c108d94fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57822c1558143d38ad17326a742c370'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:45.493943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1243/2496] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:16:45 2022] DELETE /identity/v3/users/a57822c1558143d38ad17326a742c370 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:16:45.918353 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8108b9-7841-47d1-a6f8-e7a32261262f service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:45.929326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8108b9-7841-47d1-a6f8-e7a32261262f service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:45.990654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:45.991534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:45.991813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:45.992080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] PATH_INFO: `/v3/projects/74d48ee3a0df47dab968b0b92443648c` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:45.993552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d48ee3a0df47dab968b0b92443648c)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:45.995501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:46.003474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:46.042286 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d48ee3a0df47dab968b0b92443648c', 'request_id': 'req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:46.048734 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d48ee3a0df47dab968b0b92443648c', 'request_id': 'req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:46.054020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d48ee3a0df47dab968b0b92443648c', 'request_id': 'req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:46.064788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] The token cache is being invalidate because project 74d48ee3a0df47dab968b0b92443648c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:46.065067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:46.065690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fc85a29c-30b1-4e2d-84a8-a69a0916f5c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:46.067247 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1254/2497] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:45 2022] DELETE /identity/v3/projects/74d48ee3a0df47dab968b0b92443648c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:46.072680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e687c4-e15a-4f6e-adfc-2942038b169b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:46.073006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e687c4-e15a-4f6e-adfc-2942038b169b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:46.073283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e687c4-e15a-4f6e-adfc-2942038b169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:46.091544 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-52e687c4-e15a-4f6e-adfc-2942038b169b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:46.092805 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-52e687c4-e15a-4f6e-adfc-2942038b169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:46.152916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1244/2498] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:46.160928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560dbfd-928a-40e7-99f2-ba9e047699cc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:46.161220 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560dbfd-928a-40e7-99f2-ba9e047699cc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:46.161562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560dbfd-928a-40e7-99f2-ba9e047699cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:46.179651 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-4560dbfd-928a-40e7-99f2-ba9e047699cc None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:46.181248 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4560dbfd-928a-40e7-99f2-ba9e047699cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:46.189140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1255/2499] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:46.193373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e687c4-e15a-4f6e-adfc-2942038b169b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:46.203934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e687c4-e15a-4f6e-adfc-2942038b169b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:46.208397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d924ca2-313d-4c9f-996f-18506ba19b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:46.209036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d924ca2-313d-4c9f-996f-18506ba19b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:46.209313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d924ca2-313d-4c9f-996f-18506ba19b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:46.209582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d924ca2-313d-4c9f-996f-18506ba19b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:46.210293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d924ca2-313d-4c9f-996f-18506ba19b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:16:46.210600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d924ca2-313d-4c9f-996f-18506ba19b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:46.213167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d924ca2-313d-4c9f-996f-18506ba19b8a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:46.224470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1245/2500] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:16:46.229078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560dbfd-928a-40e7-99f2-ba9e047699cc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:46.238448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560dbfd-928a-40e7-99f2-ba9e047699cc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:46.243131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeb751-0190-4e3d-bfd0-63f30c839362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:46.243924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeb751-0190-4e3d-bfd0-63f30c839362 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:46.244212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeb751-0190-4e3d-bfd0-63f30c839362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:46.244491 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeb751-0190-4e3d-bfd0-63f30c839362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:46.245184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eeb751-0190-4e3d-bfd0-63f30c839362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:46.247148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eeb751-0190-4e3d-bfd0-63f30c839362 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:46.282128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1256/2501] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:16:46 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:16:46.286314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d924ca2-313d-4c9f-996f-18506ba19b8a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:46.296277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d924ca2-313d-4c9f-996f-18506ba19b8a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:46.357293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b4cd7-ac39-42ce-9139-79348f8f9f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:46.357880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b4cd7-ac39-42ce-9139-79348f8f9f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:46.358161 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b4cd7-ac39-42ce-9139-79348f8f9f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:46.358431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b4cd7-ac39-42ce-9139-79348f8f9f19 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:46.359152 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b4cd7-ac39-42ce-9139-79348f8f9f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:46.361038 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b4cd7-ac39-42ce-9139-79348f8f9f19 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:46.367621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:46.383088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1246/2502] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:16:46 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:46.388100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeb751-0190-4e3d-bfd0-63f30c839362 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:46.404367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeb751-0190-4e3d-bfd0-63f30c839362 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:46.410827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a13f7-b105-4c7c-ac02-b00b8adca8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:46.411496 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a13f7-b105-4c7c-ac02-b00b8adca8dc admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:46.411801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a13f7-b105-4c7c-ac02-b00b8adca8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:46.412061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a13f7-b105-4c7c-ac02-b00b8adca8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:46.412790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a13f7-b105-4c7c-ac02-b00b8adca8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:46.414388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a13f7-b105-4c7c-ac02-b00b8adca8dc admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:46.424993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1257/2503] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:46.429119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b4cd7-ac39-42ce-9139-79348f8f9f19 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:46.440289 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b4cd7-ac39-42ce-9139-79348f8f9f19 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:46.444895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bc2d2-0ad7-4f3c-a742-b3e39469702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:46.445583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc2d2-0ad7-4f3c-a742-b3e39469702c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:46.445864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc2d2-0ad7-4f3c-a742-b3e39469702c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:46.446752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc2d2-0ad7-4f3c-a742-b3e39469702c admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:46.447480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bc2d2-0ad7-4f3c-a742-b3e39469702c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:46.449106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bc2d2-0ad7-4f3c-a742-b3e39469702c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:46.459300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1247/2504] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:46.463782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a13f7-b105-4c7c-ac02-b00b8adca8dc admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:46.473725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a13f7-b105-4c7c-ac02-b00b8adca8dc admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:46.478502 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0483e60-96d9-4b85-90de-0f2cc6f560cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:46.479400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0483e60-96d9-4b85-90de-0f2cc6f560cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:46.479679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0483e60-96d9-4b85-90de-0f2cc6f560cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:46.479949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0483e60-96d9-4b85-90de-0f2cc6f560cd admin admin] PATH_INFO: `/v3/projects/fbb262a49e7943969341fe4844bf6ca2/users/b2f00979211947b1b8e04b69c0fbba78/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:46.495896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0483e60-96d9-4b85-90de-0f2cc6f560cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb262a49e7943969341fe4844bf6ca2, user_id=b2f00979211947b1b8e04b69c0fbba78, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:46.498841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0483e60-96d9-4b85-90de-0f2cc6f560cd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:46.512654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1258/2505] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:46 2022] PUT /identity/v3/projects/fbb262a49e7943969341fe4844bf6ca2/users/b2f00979211947b1b8e04b69c0fbba78/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:46.522603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ac208-0394-4c94-9488-2b1a3f1a858b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:46.522941 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ac208-0394-4c94-9488-2b1a3f1a858b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:46.523228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ac208-0394-4c94-9488-2b1a3f1a858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:46.552423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-842ac208-0394-4c94-9488-2b1a3f1a858b None None] MFA Rules not processed for user `b2f00979211947b1b8e04b69c0fbba78`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:46.553613 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-842ac208-0394-4c94-9488-2b1a3f1a858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:46.615760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1248/2506] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:46.627059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0483e60-96d9-4b85-90de-0f2cc6f560cd admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:46.629007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d0483e60-96d9-4b85-90de-0f2cc6f560cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:46.705932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0483e60-96d9-4b85-90de-0f2cc6f560cd admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:46.711505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb193c-9d17-46ce-b87e-eedb3191548e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:46.712768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb193c-9d17-46ce-b87e-eedb3191548e service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:46.713054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb193c-9d17-46ce-b87e-eedb3191548e service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:46.713332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb193c-9d17-46ce-b87e-eedb3191548e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:46.721058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb193c-9d17-46ce-b87e-eedb3191548e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:46.722649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb193c-9d17-46ce-b87e-eedb3191548e service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:46.731667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1259/2507] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:46.953588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ac208-0394-4c94-9488-2b1a3f1a858b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:47.020886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ac208-0394-4c94-9488-2b1a3f1a858b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:47.026005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:47.026898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.027179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.027451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] PATH_INFO: `/v3/users/b2f00979211947b1b8e04b69c0fbba78` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.028619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f00979211947b1b8e04b69c0fbba78)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:47.030518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:47.077901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f00979211947b1b8e04b69c0fbba78'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:47.084639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f00979211947b1b8e04b69c0fbba78'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:47.085295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f00979211947b1b8e04b69c0fbba78'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:47.085899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f00979211947b1b8e04b69c0fbba78'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:47.095764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:47.098426 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f00979211947b1b8e04b69c0fbba78'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:47.111693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1249/2508] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:16:46 2022] DELETE /identity/v3/users/b2f00979211947b1b8e04b69c0fbba78 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:47.116254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d4a6-849e-4278-861c-48118bad1bc8 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.116728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d4a6-849e-4278-861c-48118bad1bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.116823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d4a6-849e-4278-861c-48118bad1bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.134805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7382d4a6-849e-4278-861c-48118bad1bc8 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:47.135988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7382d4a6-849e-4278-861c-48118bad1bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:47.139927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:47.195325 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1260/2509] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:47.204933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:47.206342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:47.263227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175d465-4c2b-4d07-9f35-f57d0683e93d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:47.266826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdeaea-cd10-4965-8ab7-55036ca31d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:47.267461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdeaea-cd10-4965-8ab7-55036ca31d00 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.267743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdeaea-cd10-4965-8ab7-55036ca31d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.268018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdeaea-cd10-4965-8ab7-55036ca31d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.277652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdeaea-cd10-4965-8ab7-55036ca31d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:47.279118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdeaea-cd10-4965-8ab7-55036ca31d00 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:47.288324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1250/2510] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:47.550576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382d4a6-849e-4278-861c-48118bad1bc8 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:47.552237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7382d4a6-849e-4278-861c-48118bad1bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:47.565280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382d4a6-849e-4278-861c-48118bad1bc8 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:47.569849 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:47.570733 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.571690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.572025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] PATH_INFO: `/v3/projects/fbb262a49e7943969341fe4844bf6ca2` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.573219 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb262a49e7943969341fe4844bf6ca2)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:47.575185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:47.621881 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb262a49e7943969341fe4844bf6ca2', 'request_id': 'req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:47.629105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb262a49e7943969341fe4844bf6ca2', 'request_id': 'req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:47.635140 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb262a49e7943969341fe4844bf6ca2', 'request_id': 'req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:47.646337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] The token cache is being invalidate because project fbb262a49e7943969341fe4844bf6ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:47.646622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:47.647278 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-32b4357e-dee6-4c72-b6b9-31e8dcb234f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:47.648797 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1261/2511] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:47 2022] DELETE /identity/v3/projects/fbb262a49e7943969341fe4844bf6ca2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:47.654539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97777213-d9a3-48b1-9763-263a1f8d4647 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.655046 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97777213-d9a3-48b1-9763-263a1f8d4647 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.655151 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97777213-d9a3-48b1-9763-263a1f8d4647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.672618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-97777213-d9a3-48b1-9763-263a1f8d4647 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:47.673964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-97777213-d9a3-48b1-9763-263a1f8d4647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:47.732285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1251/2512] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:47.741177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a6b2-27aa-465d-bc53-3379f3609fdc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.741465 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a6b2-27aa-465d-bc53-3379f3609fdc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.741742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a6b2-27aa-465d-bc53-3379f3609fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.760947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b343a6b2-27aa-465d-bc53-3379f3609fdc None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:47.762128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b343a6b2-27aa-465d-bc53-3379f3609fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:47.770015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1262/2513] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:47.774099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97777213-d9a3-48b1-9763-263a1f8d4647 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:47.784591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97777213-d9a3-48b1-9763-263a1f8d4647 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:47.789087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef4e54-1c16-4474-9871-3fe21640f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:47.789788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef4e54-1c16-4474-9871-3fe21640f83a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.790303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef4e54-1c16-4474-9871-3fe21640f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.790611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef4e54-1c16-4474-9871-3fe21640f83a admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.791368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef4e54-1c16-4474-9871-3fe21640f83a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:16:47.791702 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef4e54-1c16-4474-9871-3fe21640f83a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:47.793277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef4e54-1c16-4474-9871-3fe21640f83a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:47.804518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1252/2514] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:16:47.809153 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343a6b2-27aa-465d-bc53-3379f3609fdc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:47.818312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343a6b2-27aa-465d-bc53-3379f3609fdc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:47.823718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30a75-6e2b-4e55-b4de-e848046c6752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:47.824362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30a75-6e2b-4e55-b4de-e848046c6752 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.824649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30a75-6e2b-4e55-b4de-e848046c6752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.824920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30a75-6e2b-4e55-b4de-e848046c6752 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.825610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d30a75-6e2b-4e55-b4de-e848046c6752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:47.827548 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d30a75-6e2b-4e55-b4de-e848046c6752 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:47.852474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1263/2515] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:16:47 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:47.856560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef4e54-1c16-4474-9871-3fe21640f83a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:47.866252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef4e54-1c16-4474-9871-3fe21640f83a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:47.921596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e17cb-e560-4d80-a252-7592d8b236b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:47.922251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e17cb-e560-4d80-a252-7592d8b236b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.922534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e17cb-e560-4d80-a252-7592d8b236b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.922844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e17cb-e560-4d80-a252-7592d8b236b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.923533 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e17cb-e560-4d80-a252-7592d8b236b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:47.925582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e17cb-e560-4d80-a252-7592d8b236b8 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:47.945424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1253/2516] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:16:47 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:47.950245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30a75-6e2b-4e55-b4de-e848046c6752 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:47.960275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30a75-6e2b-4e55-b4de-e848046c6752 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:47.964969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d1e0-8ab9-453e-9be7-a88bc65f746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:47.965616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d1e0-8ab9-453e-9be7-a88bc65f746c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.965895 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d1e0-8ab9-453e-9be7-a88bc65f746c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.966170 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d1e0-8ab9-453e-9be7-a88bc65f746c admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.966918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999d1e0-8ab9-453e-9be7-a88bc65f746c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:47.968495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999d1e0-8ab9-453e-9be7-a88bc65f746c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:47.978636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1264/2517] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:47.982327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e17cb-e560-4d80-a252-7592d8b236b8 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:47.991869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e17cb-e560-4d80-a252-7592d8b236b8 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:47.996943 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c89f1-99c1-43d9-8497-5ceeb8068465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:47.997589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c89f1-99c1-43d9-8497-5ceeb8068465 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:47.997869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c89f1-99c1-43d9-8497-5ceeb8068465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:47.998143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c89f1-99c1-43d9-8497-5ceeb8068465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:47.998888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c89f1-99c1-43d9-8497-5ceeb8068465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:48.000454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c89f1-99c1-43d9-8497-5ceeb8068465 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:48.001673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:48.015149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1254/2518] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:16:48.018771 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d1e0-8ab9-453e-9be7-a88bc65f746c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:48.028754 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d1e0-8ab9-453e-9be7-a88bc65f746c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:48.033369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf60ce5-047d-4f98-aa22-3f729653f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:48.034264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf60ce5-047d-4f98-aa22-3f729653f421 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.034551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf60ce5-047d-4f98-aa22-3f729653f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.034875 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf60ce5-047d-4f98-aa22-3f729653f421 admin admin] PATH_INFO: `/v3/projects/0ff31d07112e4b6dae1909240eb558fa/users/6c222a0f4fc44c368b676b59594da399/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.049180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf60ce5-047d-4f98-aa22-3f729653f421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff31d07112e4b6dae1909240eb558fa, user_id=6c222a0f4fc44c368b676b59594da399, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:48.051905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf60ce5-047d-4f98-aa22-3f729653f421 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:48.064902 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1265/2519] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:48 2022] PUT /identity/v3/projects/0ff31d07112e4b6dae1909240eb558fa/users/6c222a0f4fc44c368b676b59594da399/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:48.075643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e53372-f31f-4a8f-8363-579f049a2607 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.075936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e53372-f31f-4a8f-8363-579f049a2607 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.076214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e53372-f31f-4a8f-8363-579f049a2607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.103227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-11e53372-f31f-4a8f-8363-579f049a2607 None None] MFA Rules not processed for user `6c222a0f4fc44c368b676b59594da399`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:48.104520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-11e53372-f31f-4a8f-8363-579f049a2607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:48.170506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1255/2520] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:48.174993 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf60ce5-047d-4f98-aa22-3f729653f421 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:48.206375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:48.239198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf60ce5-047d-4f98-aa22-3f729653f421 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:48.244660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c9e12-c944-4dc9-ba8e-036581958bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:48.245319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c9e12-c944-4dc9-ba8e-036581958bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.245603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c9e12-c944-4dc9-ba8e-036581958bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.245901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c9e12-c944-4dc9-ba8e-036581958bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.246636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c9e12-c944-4dc9-ba8e-036581958bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:48.248718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c9e12-c944-4dc9-ba8e-036581958bd6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:48.273698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1266/2521] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:16:48 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:48.277889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e53372-f31f-4a8f-8363-579f049a2607 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:48.288545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e53372-f31f-4a8f-8363-579f049a2607 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:48.344157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707b7a7-4597-4fda-ab40-2fd9105f26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:48.344813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707b7a7-4597-4fda-ab40-2fd9105f26c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.345092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707b7a7-4597-4fda-ab40-2fd9105f26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.345364 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707b7a7-4597-4fda-ab40-2fd9105f26c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.346038 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707b7a7-4597-4fda-ab40-2fd9105f26c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:48.347987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707b7a7-4597-4fda-ab40-2fd9105f26c2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:48.367238 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1256/2522] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:16:48 2022] POST /identity/v3/users => generated 309 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:48.372518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c9e12-c944-4dc9-ba8e-036581958bd6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:48.383025 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c9e12-c944-4dc9-ba8e-036581958bd6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:48.387623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3940b20-7dc0-4670-9edf-4592deb9106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:48.388277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3940b20-7dc0-4670-9edf-4592deb9106a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.388561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3940b20-7dc0-4670-9edf-4592deb9106a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.388838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3940b20-7dc0-4670-9edf-4592deb9106a admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.389586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3940b20-7dc0-4670-9edf-4592deb9106a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:48.391213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3940b20-7dc0-4670-9edf-4592deb9106a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:48.402628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1267/2523] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:16:48.406766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707b7a7-4597-4fda-ab40-2fd9105f26c2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:48.417916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707b7a7-4597-4fda-ab40-2fd9105f26c2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:48.422585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3cb3-d610-4c0c-b4ca-f22667f4a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:48.423498 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3cb3-d610-4c0c-b4ca-f22667f4a17b admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.423784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3cb3-d610-4c0c-b4ca-f22667f4a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.424062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3cb3-d610-4c0c-b4ca-f22667f4a17b admin admin] PATH_INFO: `/v3/projects/e583988cc63e41b08bfb9f98ded4b278/users/7bdb8856c23b4b0b96269c7a830a3aff/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.438999 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce3cb3-d610-4c0c-b4ca-f22667f4a17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e583988cc63e41b08bfb9f98ded4b278, user_id=7bdb8856c23b4b0b96269c7a830a3aff, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:48.441647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce3cb3-d610-4c0c-b4ca-f22667f4a17b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:48.454593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1257/2524] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:48 2022] PUT /identity/v3/projects/e583988cc63e41b08bfb9f98ded4b278/users/7bdb8856c23b4b0b96269c7a830a3aff/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:48.458536 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3940b20-7dc0-4670-9edf-4592deb9106a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:48.469403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3940b20-7dc0-4670-9edf-4592deb9106a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:48.525393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200babf-22c3-4b53-a437-d3b5e5019e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:48.526029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200babf-22c3-4b53-a437-d3b5e5019e7a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.526341 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200babf-22c3-4b53-a437-d3b5e5019e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.526610 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200babf-22c3-4b53-a437-d3b5e5019e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.527359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200babf-22c3-4b53-a437-d3b5e5019e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:48.528958 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200babf-22c3-4b53-a437-d3b5e5019e7a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:48.538864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1268/2525] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:48.543243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3cb3-d610-4c0c-b4ca-f22667f4a17b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:48.553379 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3cb3-d610-4c0c-b4ca-f22667f4a17b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:48.558648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22bb62-9d1f-40c9-b666-35bab0775a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:48.559557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bb62-9d1f-40c9-b666-35bab0775a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.559866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bb62-9d1f-40c9-b666-35bab0775a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.560144 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bb62-9d1f-40c9-b666-35bab0775a0f admin admin] PATH_INFO: `/v3/projects/e583988cc63e41b08bfb9f98ded4b278/users/7bdb8856c23b4b0b96269c7a830a3aff/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.562086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22bb62-9d1f-40c9-b666-35bab0775a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e583988cc63e41b08bfb9f98ded4b278, user_id=7bdb8856c23b4b0b96269c7a830a3aff, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:48.564753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22bb62-9d1f-40c9-b666-35bab0775a0f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:48.575475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1258/2526] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:48 2022] PUT /identity/v3/projects/e583988cc63e41b08bfb9f98ded4b278/users/7bdb8856c23b4b0b96269c7a830a3aff/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:48.586001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8d1b6-b0c5-453f-a884-452b5198eabc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.586319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8d1b6-b0c5-453f-a884-452b5198eabc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.586594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8d1b6-b0c5-453f-a884-452b5198eabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.612336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-11d8d1b6-b0c5-453f-a884-452b5198eabc None None] MFA Rules not processed for user `7bdb8856c23b4b0b96269c7a830a3aff`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:48.613595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-11d8d1b6-b0c5-453f-a884-452b5198eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:48.682282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1269/2527] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:48.692815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22bb62-9d1f-40c9-b666-35bab0775a0f admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:48.694534 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8e22bb62-9d1f-40c9-b666-35bab0775a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:48.738545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:48.755476 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22bb62-9d1f-40c9-b666-35bab0775a0f admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:48.759769 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe95fb-f4dd-42be-a3af-b3c455567098 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:48.760411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe95fb-f4dd-42be-a3af-b3c455567098 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.760696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe95fb-f4dd-42be-a3af-b3c455567098 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.760978 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe95fb-f4dd-42be-a3af-b3c455567098 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.770058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe95fb-f4dd-42be-a3af-b3c455567098 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:48.771527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe95fb-f4dd-42be-a3af-b3c455567098 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:48.781084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1259/2528] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:48.916636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8d1b6-b0c5-453f-a884-452b5198eabc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:48.943199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:48.979336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8d1b6-b0c5-453f-a884-452b5198eabc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:48.983785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:48.984649 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:48.984931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:48.985205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] PATH_INFO: `/v3/users/6c222a0f4fc44c368b676b59594da399` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:48.986374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c222a0f4fc44c368b676b59594da399)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:48.988326 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:49.033132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c222a0f4fc44c368b676b59594da399'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.033708 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c222a0f4fc44c368b676b59594da399'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.041002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c222a0f4fc44c368b676b59594da399'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.041633 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c222a0f4fc44c368b676b59594da399'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.053679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c222a0f4fc44c368b676b59594da399'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.066403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1270/2529] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:16:48 2022] DELETE /identity/v3/users/6c222a0f4fc44c368b676b59594da399 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:16:49.071286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ddb48-c386-4259-b106-3c3402fbccfe None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:49.072302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ddb48-c386-4259-b106-3c3402fbccfe None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:49.072588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ddb48-c386-4259-b106-3c3402fbccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:49.089965 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-239ddb48-c386-4259-b106-3c3402fbccfe None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:49.091264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-239ddb48-c386-4259-b106-3c3402fbccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:49.150012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1260/2530] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:49.159691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:49.161111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:49.219122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9304d6-a0e8-4b25-a62b-d3caed98473e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:49.222764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4e207-ae78-4c3f-ab2d-8a2c48083286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:49.223407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4e207-ae78-4c3f-ab2d-8a2c48083286 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:49.223686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4e207-ae78-4c3f-ab2d-8a2c48083286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:49.223960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4e207-ae78-4c3f-ab2d-8a2c48083286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:49.233764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4e207-ae78-4c3f-ab2d-8a2c48083286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:49.235243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4e207-ae78-4c3f-ab2d-8a2c48083286 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:49.245162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1271/2531] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:16:49.523092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ddb48-c386-4259-b106-3c3402fbccfe None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:49.525193 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-239ddb48-c386-4259-b106-3c3402fbccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:49.538274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ddb48-c386-4259-b106-3c3402fbccfe None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:49.543879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:49.544772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:49.545059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:49.545335 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] PATH_INFO: `/v3/projects/0ff31d07112e4b6dae1909240eb558fa` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:49.547526 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff31d07112e4b6dae1909240eb558fa)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:49.549525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:49.596548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff31d07112e4b6dae1909240eb558fa', 'request_id': 'req-b7f1b782-c967-4260-b2b7-9ecc16a7c560'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.604077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff31d07112e4b6dae1909240eb558fa', 'request_id': 'req-b7f1b782-c967-4260-b2b7-9ecc16a7c560'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.610414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff31d07112e4b6dae1909240eb558fa', 'request_id': 'req-b7f1b782-c967-4260-b2b7-9ecc16a7c560'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.620575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] The token cache is being invalidate because project 0ff31d07112e4b6dae1909240eb558fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:49.620862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.621487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.623060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1261/2532] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:49 2022] DELETE /identity/v3/projects/0ff31d07112e4b6dae1909240eb558fa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:49.627137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4e207-ae78-4c3f-ab2d-8a2c48083286 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:49.636844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4e207-ae78-4c3f-ab2d-8a2c48083286 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:49.680176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:49.694219 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:49.695114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:49.695394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:49.695662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] PATH_INFO: `/v3/users/7bdb8856c23b4b0b96269c7a830a3aff` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:49.697643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bdb8856c23b4b0b96269c7a830a3aff)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:49.699579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:49.745309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bdb8856c23b4b0b96269c7a830a3aff'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.745975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bdb8856c23b4b0b96269c7a830a3aff'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.753336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bdb8856c23b4b0b96269c7a830a3aff'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.753985 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bdb8856c23b4b0b96269c7a830a3aff'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.768759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a1e7fd08-4134-49f3-bb1e-562b40c64e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bdb8856c23b4b0b96269c7a830a3aff'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:49.782029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1272/2533] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:16:49 2022] DELETE /identity/v3/users/7bdb8856c23b4b0b96269c7a830a3aff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:50.062497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.063840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:50.078930 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1b782-c967-4260-b2b7-9ecc16a7c560 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.137040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.137900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.138181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.138454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] PATH_INFO: `/v3/projects/e583988cc63e41b08bfb9f98ded4b278` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.139662 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e583988cc63e41b08bfb9f98ded4b278)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:50.141566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:50.147713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:50.190934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e583988cc63e41b08bfb9f98ded4b278', 'request_id': 'req-484db63e-7e5a-459a-85a9-010fc01f9cbd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:50.198143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e583988cc63e41b08bfb9f98ded4b278', 'request_id': 'req-484db63e-7e5a-459a-85a9-010fc01f9cbd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:50.204414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e583988cc63e41b08bfb9f98ded4b278', 'request_id': 'req-484db63e-7e5a-459a-85a9-010fc01f9cbd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:50.215198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] The token cache is being invalidate because project e583988cc63e41b08bfb9f98ded4b278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:50.215487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:50.216114 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-484db63e-7e5a-459a-85a9-010fc01f9cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:50.217647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1262/2534] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:50 2022] DELETE /identity/v3/projects/e583988cc63e41b08bfb9f98ded4b278 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:50.222518 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ba82b-7eb5-4e11-a051-0ca619cfccef None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.223023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ba82b-7eb5-4e11-a051-0ca619cfccef None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.223115 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ba82b-7eb5-4e11-a051-0ca619cfccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.240940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-891ba82b-7eb5-4e11-a051-0ca619cfccef None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:50.242131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-891ba82b-7eb5-4e11-a051-0ca619cfccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:50.301362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1273/2535] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:50.309345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fbf2b-2ab2-41e2-baa3-c254b89ae5a2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.309665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fbf2b-2ab2-41e2-baa3-c254b89ae5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.309947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fbf2b-2ab2-41e2-baa3-c254b89ae5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.332620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b26fbf2b-2ab2-41e2-baa3-c254b89ae5a2 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:50.333835 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b26fbf2b-2ab2-41e2-baa3-c254b89ae5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:50.342345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1263/2536] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:50.346694 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ba82b-7eb5-4e11-a051-0ca619cfccef None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.357004 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ba82b-7eb5-4e11-a051-0ca619cfccef None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.361525 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f6fce-7d7f-449a-bafd-76470bb4ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.362174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f6fce-7d7f-449a-bafd-76470bb4ab99 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.362459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f6fce-7d7f-449a-bafd-76470bb4ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.362765 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f6fce-7d7f-449a-bafd-76470bb4ab99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.363493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f6fce-7d7f-449a-bafd-76470bb4ab99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:16:50.363833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f6fce-7d7f-449a-bafd-76470bb4ab99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:50.365432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f6fce-7d7f-449a-bafd-76470bb4ab99 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:50.377040 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1274/2537] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:16:50.381330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fbf2b-2ab2-41e2-baa3-c254b89ae5a2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.390555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fbf2b-2ab2-41e2-baa3-c254b89ae5a2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.395164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c80c1-2661-4c40-b571-4ddc8c066b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.395803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c80c1-2661-4c40-b571-4ddc8c066b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.396085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c80c1-2661-4c40-b571-4ddc8c066b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.396357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c80c1-2661-4c40-b571-4ddc8c066b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.397051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c80c1-2661-4c40-b571-4ddc8c066b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:50.398956 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c80c1-2661-4c40-b571-4ddc8c066b4c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:50.425488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1264/2538] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:16:50 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:16:50.429614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f6fce-7d7f-449a-bafd-76470bb4ab99 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.439950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f6fce-7d7f-449a-bafd-76470bb4ab99 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.487253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:50.497803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fde331-dd07-45b6-a2cf-2f2eac645687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.498472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fde331-dd07-45b6-a2cf-2f2eac645687 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.498800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fde331-dd07-45b6-a2cf-2f2eac645687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.499092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fde331-dd07-45b6-a2cf-2f2eac645687 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.499777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fde331-dd07-45b6-a2cf-2f2eac645687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:50.501715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fde331-dd07-45b6-a2cf-2f2eac645687 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:50.522796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1275/2539] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:16:50 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:50.527285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c80c1-2661-4c40-b571-4ddc8c066b4c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.537481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c80c1-2661-4c40-b571-4ddc8c066b4c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.542302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf0851-524c-434d-a7cf-6f429637dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.542994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf0851-524c-434d-a7cf-6f429637dc90 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.543280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf0851-524c-434d-a7cf-6f429637dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.543559 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf0851-524c-434d-a7cf-6f429637dc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.544277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf0851-524c-434d-a7cf-6f429637dc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:50.545909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf0851-524c-434d-a7cf-6f429637dc90 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:50.557405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1265/2540] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:50.561380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fde331-dd07-45b6-a2cf-2f2eac645687 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.571845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fde331-dd07-45b6-a2cf-2f2eac645687 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.576335 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2b402-069e-4b96-adb9-75af0ec326d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.576982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2b402-069e-4b96-adb9-75af0ec326d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.577263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2b402-069e-4b96-adb9-75af0ec326d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.577534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2b402-069e-4b96-adb9-75af0ec326d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.578277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2b402-069e-4b96-adb9-75af0ec326d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:50.579886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2b402-069e-4b96-adb9-75af0ec326d5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:50.590154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1276/2541] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:50.594110 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf0851-524c-434d-a7cf-6f429637dc90 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.604036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf0851-524c-434d-a7cf-6f429637dc90 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.608681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10591ab-faf3-4f31-ac0d-40df2ae6047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.609550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10591ab-faf3-4f31-ac0d-40df2ae6047d admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.609836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10591ab-faf3-4f31-ac0d-40df2ae6047d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.610115 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10591ab-faf3-4f31-ac0d-40df2ae6047d admin admin] PATH_INFO: `/v3/projects/e293cf84535c4f978a8e4c75d1f93b31/users/5b7c8501bcc44e40ac4beb668ad410d1/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.624483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10591ab-faf3-4f31-ac0d-40df2ae6047d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e293cf84535c4f978a8e4c75d1f93b31, user_id=5b7c8501bcc44e40ac4beb668ad410d1, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:50.627158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10591ab-faf3-4f31-ac0d-40df2ae6047d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:50.640490 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1266/2542] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:50 2022] PUT /identity/v3/projects/e293cf84535c4f978a8e4c75d1f93b31/users/5b7c8501bcc44e40ac4beb668ad410d1/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:16:50.651420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fc5cc-5750-47cd-b91e-5484e96f5e08 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.651631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fc5cc-5750-47cd-b91e-5484e96f5e08 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.651932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fc5cc-5750-47cd-b91e-5484e96f5e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.677544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e92fc5cc-5750-47cd-b91e-5484e96f5e08 None None] MFA Rules not processed for user `5b7c8501bcc44e40ac4beb668ad410d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:50.678747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e92fc5cc-5750-47cd-b91e-5484e96f5e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:50.742079 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1277/2543] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:50.746525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10591ab-faf3-4f31-ac0d-40df2ae6047d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.810462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10591ab-faf3-4f31-ac0d-40df2ae6047d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.815081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069c74-c0d0-40dd-9c73-7b301cbecb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.815755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069c74-c0d0-40dd-9c73-7b301cbecb3d admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.816035 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069c74-c0d0-40dd-9c73-7b301cbecb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.816307 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069c74-c0d0-40dd-9c73-7b301cbecb3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.816981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd069c74-c0d0-40dd-9c73-7b301cbecb3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:50.818891 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd069c74-c0d0-40dd-9c73-7b301cbecb3d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:50.844162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1267/2544] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:16:50 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:50.848253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fc5cc-5750-47cd-b91e-5484e96f5e08 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.859147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fc5cc-5750-47cd-b91e-5484e96f5e08 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.915731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b161e0-7460-4fef-b859-024c7fde5971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.916333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b161e0-7460-4fef-b859-024c7fde5971 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.916615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b161e0-7460-4fef-b859-024c7fde5971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.916888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b161e0-7460-4fef-b859-024c7fde5971 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.917579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b161e0-7460-4fef-b859-024c7fde5971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:50.919534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b161e0-7460-4fef-b859-024c7fde5971 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:50.939842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1278/2545] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:16:50 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:16:50.943842 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069c74-c0d0-40dd-9c73-7b301cbecb3d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.955537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069c74-c0d0-40dd-9c73-7b301cbecb3d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.960062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c962720-c27b-4bfc-aefe-d914f70e0241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.960709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962720-c27b-4bfc-aefe-d914f70e0241 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.960990 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962720-c27b-4bfc-aefe-d914f70e0241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.961267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962720-c27b-4bfc-aefe-d914f70e0241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:50.962477 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c962720-c27b-4bfc-aefe-d914f70e0241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:50.964100 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c962720-c27b-4bfc-aefe-d914f70e0241 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:50.974391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1268/2546] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:50.978723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b161e0-7460-4fef-b859-024c7fde5971 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:50.988725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b161e0-7460-4fef-b859-024c7fde5971 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:50.993920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115ed08-3aaa-4233-b043-a06f7130e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:50.994837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115ed08-3aaa-4233-b043-a06f7130e793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:50.995124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115ed08-3aaa-4233-b043-a06f7130e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:50.995429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115ed08-3aaa-4233-b043-a06f7130e793 admin admin] PATH_INFO: `/v3/projects/32ba1f1a688a49da9d578bd8e89e84ca/users/092412e469914449ada7368c1459c99c/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:51.010909 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115ed08-3aaa-4233-b043-a06f7130e793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ba1f1a688a49da9d578bd8e89e84ca, user_id=092412e469914449ada7368c1459c99c, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:51.013850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115ed08-3aaa-4233-b043-a06f7130e793 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:51.027737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1279/2547] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:50 2022] PUT /identity/v3/projects/32ba1f1a688a49da9d578bd8e89e84ca/users/092412e469914449ada7368c1459c99c/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:16:51.031714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c962720-c27b-4bfc-aefe-d914f70e0241 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:51.038048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:51.042082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c962720-c27b-4bfc-aefe-d914f70e0241 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:51.100129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f6329-7eed-4bad-98d5-1b2f3bd842ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:51.100793 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f6329-7eed-4bad-98d5-1b2f3bd842ce admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:51.101062 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f6329-7eed-4bad-98d5-1b2f3bd842ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:51.101341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f6329-7eed-4bad-98d5-1b2f3bd842ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:51.102064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f6329-7eed-4bad-98d5-1b2f3bd842ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:51.103843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f6329-7eed-4bad-98d5-1b2f3bd842ce admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:51.113386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1269/2548] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:51.119160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115ed08-3aaa-4233-b043-a06f7130e793 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:51.131768 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115ed08-3aaa-4233-b043-a06f7130e793 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:51.137251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ea27b-5c53-4032-8331-dbc391b1cf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:51.138139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea27b-5c53-4032-8331-dbc391b1cf97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:51.138428 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea27b-5c53-4032-8331-dbc391b1cf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:51.138731 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea27b-5c53-4032-8331-dbc391b1cf97 admin admin] PATH_INFO: `/v3/projects/32ba1f1a688a49da9d578bd8e89e84ca/users/092412e469914449ada7368c1459c99c/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:51.140696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ea27b-5c53-4032-8331-dbc391b1cf97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ba1f1a688a49da9d578bd8e89e84ca, user_id=092412e469914449ada7368c1459c99c, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:51.143378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ea27b-5c53-4032-8331-dbc391b1cf97 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:51.154266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1280/2549] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:51 2022] PUT /identity/v3/projects/32ba1f1a688a49da9d578bd8e89e84ca/users/092412e469914449ada7368c1459c99c/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:51.166564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c701-dd1e-473d-9233-a7025f056a85 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:51.166810 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c701-dd1e-473d-9233-a7025f056a85 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:51.167092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c701-dd1e-473d-9233-a7025f056a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:51.193605 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f0f3c701-dd1e-473d-9233-a7025f056a85 None None] MFA Rules not processed for user `092412e469914449ada7368c1459c99c`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:51.194858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f0f3c701-dd1e-473d-9233-a7025f056a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:51.262003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1270/2550] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:51.273509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ea27b-5c53-4032-8331-dbc391b1cf97 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:51.275437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c43ea27b-5c53-4032-8331-dbc391b1cf97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:51.290764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:51.333933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ea27b-5c53-4032-8331-dbc391b1cf97 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:51.337730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5261d8-08a7-4dbe-a5b8-1e0f2854326c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:51.338373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5261d8-08a7-4dbe-a5b8-1e0f2854326c service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:51.338655 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5261d8-08a7-4dbe-a5b8-1e0f2854326c service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:51.338961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5261d8-08a7-4dbe-a5b8-1e0f2854326c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:51.347870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5261d8-08a7-4dbe-a5b8-1e0f2854326c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:51.349289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5261d8-08a7-4dbe-a5b8-1e0f2854326c service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:51.359164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1281/2551] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:51.422418 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3c701-dd1e-473d-9233-a7025f056a85 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:51.491728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3c701-dd1e-473d-9233-a7025f056a85 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:51.497103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:51.497963 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:51.498247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:51.498517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] PATH_INFO: `/v3/users/5b7c8501bcc44e40ac4beb668ad410d1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:51.499731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7c8501bcc44e40ac4beb668ad410d1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:51.501630 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:51.531703 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:51.551340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7c8501bcc44e40ac4beb668ad410d1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:51.558147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7c8501bcc44e40ac4beb668ad410d1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:51.558832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7c8501bcc44e40ac4beb668ad410d1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:51.559433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7c8501bcc44e40ac4beb668ad410d1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:51.571200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7c8501bcc44e40ac4beb668ad410d1'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:51.584002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1271/2552] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:16:51 2022] DELETE /identity/v3/users/5b7c8501bcc44e40ac4beb668ad410d1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:51.589288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9481b40-f117-4ee6-8487-7fb8d36e1391 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:51.589585 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9481b40-f117-4ee6-8487-7fb8d36e1391 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:51.589868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9481b40-f117-4ee6-8487-7fb8d36e1391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:51.608075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-c9481b40-f117-4ee6-8487-7fb8d36e1391 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:51.609273 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c9481b40-f117-4ee6-8487-7fb8d36e1391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:51.668048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1282/2553] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:51.677546 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:51.679010 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:51.736705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e663dc2-fef0-47e3-9817-cae9ed919839 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:51.740350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244c9d-b009-47f6-8ca3-28a080a7cf5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:51.740992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244c9d-b009-47f6-8ca3-28a080a7cf5c service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:51.741743 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244c9d-b009-47f6-8ca3-28a080a7cf5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:51.742017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244c9d-b009-47f6-8ca3-28a080a7cf5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:51.752824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244c9d-b009-47f6-8ca3-28a080a7cf5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:51.754511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244c9d-b009-47f6-8ca3-28a080a7cf5c service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:51.776007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1272/2554] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:52.044672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9481b40-f117-4ee6-8487-7fb8d36e1391 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:52.046118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c9481b40-f117-4ee6-8487-7fb8d36e1391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:52.059730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9481b40-f117-4ee6-8487-7fb8d36e1391 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:52.064920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:52.066162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:52.066409 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:52.066827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] PATH_INFO: `/v3/projects/e293cf84535c4f978a8e4c75d1f93b31` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:52.068015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e293cf84535c4f978a8e4c75d1f93b31)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:52.069911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:52.116963 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e293cf84535c4f978a8e4c75d1f93b31', 'request_id': 'req-3efadbfb-aae4-45a4-9729-e6c89b4647f6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.124289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e293cf84535c4f978a8e4c75d1f93b31', 'request_id': 'req-3efadbfb-aae4-45a4-9729-e6c89b4647f6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.130196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e293cf84535c4f978a8e4c75d1f93b31', 'request_id': 'req-3efadbfb-aae4-45a4-9729-e6c89b4647f6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.141708 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] The token cache is being invalidate because project e293cf84535c4f978a8e4c75d1f93b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:52.141999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.142632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.144185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1283/2555] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:52 2022] DELETE /identity/v3/projects/e293cf84535c4f978a8e4c75d1f93b31 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:52.148487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244c9d-b009-47f6-8ca3-28a080a7cf5c service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:52.158982 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244c9d-b009-47f6-8ca3-28a080a7cf5c service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:52.215388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:52.216192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:52.216481 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:52.216768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] PATH_INFO: `/v3/users/092412e469914449ada7368c1459c99c` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:52.217968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=092412e469914449ada7368c1459c99c)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:52.219938 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:52.265432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '092412e469914449ada7368c1459c99c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.267387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:52.272879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '092412e469914449ada7368c1459c99c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.273628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '092412e469914449ada7368c1459c99c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.275332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '092412e469914449ada7368c1459c99c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.287132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-90bae6d4-cb47-48b2-8b48-25f76fc4c4a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '092412e469914449ada7368c1459c99c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.299232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1273/2556] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:16:52 2022] DELETE /identity/v3/users/092412e469914449ada7368c1459c99c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:52.570276 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:52.571882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:52.591250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efadbfb-aae4-45a4-9729-e6c89b4647f6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:52.629913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:52.651487 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:52.652355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:52.652639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:52.652916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] PATH_INFO: `/v3/projects/32ba1f1a688a49da9d578bd8e89e84ca` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:52.654097 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ba1f1a688a49da9d578bd8e89e84ca)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:52.656447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:52.702362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ba1f1a688a49da9d578bd8e89e84ca', 'request_id': 'req-83838957-08ce-4b86-85c2-aa7e37a75fdb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.710050 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ba1f1a688a49da9d578bd8e89e84ca', 'request_id': 'req-83838957-08ce-4b86-85c2-aa7e37a75fdb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.716677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ba1f1a688a49da9d578bd8e89e84ca', 'request_id': 'req-83838957-08ce-4b86-85c2-aa7e37a75fdb'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.727654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] The token cache is being invalidate because project 32ba1f1a688a49da9d578bd8e89e84ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:52.727940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.728569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-83838957-08ce-4b86-85c2-aa7e37a75fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:52.730130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1284/2557] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:52 2022] DELETE /identity/v3/projects/32ba1f1a688a49da9d578bd8e89e84ca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:52.735002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790595-6a6d-4d09-b037-930297fa54b0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:52.735295 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790595-6a6d-4d09-b037-930297fa54b0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:52.735576 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790595-6a6d-4d09-b037-930297fa54b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:52.756054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-95790595-6a6d-4d09-b037-930297fa54b0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:52.757199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-95790595-6a6d-4d09-b037-930297fa54b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:52.815893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1274/2558] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:52.823866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab458a-3594-4cde-b2ec-53338fce850e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:52.824197 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab458a-3594-4cde-b2ec-53338fce850e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:52.824523 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab458a-3594-4cde-b2ec-53338fce850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:52.842957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7cab458a-3594-4cde-b2ec-53338fce850e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:52.844150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7cab458a-3594-4cde-b2ec-53338fce850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:52.852854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1285/2559] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:52.857113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95790595-6a6d-4d09-b037-930297fa54b0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:52.866723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95790595-6a6d-4d09-b037-930297fa54b0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:52.871899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ad74d-7173-4c36-80ad-b062e27afe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:52.872541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ad74d-7173-4c36-80ad-b062e27afe79 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:52.872823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ad74d-7173-4c36-80ad-b062e27afe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:52.873099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ad74d-7173-4c36-80ad-b062e27afe79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:52.873821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ad74d-7173-4c36-80ad-b062e27afe79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:16:52.874127 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ad74d-7173-4c36-80ad-b062e27afe79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:52.875753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ad74d-7173-4c36-80ad-b062e27afe79 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:52.887467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1275/2560] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:16:52.891618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab458a-3594-4cde-b2ec-53338fce850e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:52.901179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab458a-3594-4cde-b2ec-53338fce850e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:52.905903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aea2d-3b43-481c-bc2b-7774ac9ca3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:52.906585 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aea2d-3b43-481c-bc2b-7774ac9ca3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:52.906899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aea2d-3b43-481c-bc2b-7774ac9ca3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:52.907175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aea2d-3b43-481c-bc2b-7774ac9ca3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:52.907867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aea2d-3b43-481c-bc2b-7774ac9ca3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:52.909792 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aea2d-3b43-481c-bc2b-7774ac9ca3b6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:52.937040 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1286/2561] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:16:52 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:16:52.941204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ad74d-7173-4c36-80ad-b062e27afe79 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:52.951122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ad74d-7173-4c36-80ad-b062e27afe79 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.007228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622323f-f694-4271-b2e1-3249795335ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.007824 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622323f-f694-4271-b2e1-3249795335ca admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.008109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622323f-f694-4271-b2e1-3249795335ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.008413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622323f-f694-4271-b2e1-3249795335ca admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.009097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622323f-f694-4271-b2e1-3249795335ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.011032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622323f-f694-4271-b2e1-3249795335ca admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.030633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1276/2562] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:16:52 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:16:53.034793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aea2d-3b43-481c-bc2b-7774ac9ca3b6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:53.045690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aea2d-3b43-481c-bc2b-7774ac9ca3b6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.050345 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15322d-23fa-48bb-a4e8-2dccfa58be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.051043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15322d-23fa-48bb-a4e8-2dccfa58be7b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.051332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15322d-23fa-48bb-a4e8-2dccfa58be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.051627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15322d-23fa-48bb-a4e8-2dccfa58be7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.052710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15322d-23fa-48bb-a4e8-2dccfa58be7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.054303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15322d-23fa-48bb-a4e8-2dccfa58be7b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.064616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1287/2563] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:53.068564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622323f-f694-4271-b2e1-3249795335ca admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:53.078683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622323f-f694-4271-b2e1-3249795335ca admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.083363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6948a2-8986-4aa5-a248-1d6305978437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.084058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6948a2-8986-4aa5-a248-1d6305978437 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.084348 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6948a2-8986-4aa5-a248-1d6305978437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.084628 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6948a2-8986-4aa5-a248-1d6305978437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.085354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6948a2-8986-4aa5-a248-1d6305978437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.087622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6948a2-8986-4aa5-a248-1d6305978437 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.097940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1277/2564] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:53.102024 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15322d-23fa-48bb-a4e8-2dccfa58be7b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:53.112850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15322d-23fa-48bb-a4e8-2dccfa58be7b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.117485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cafc8f-2940-4e3b-8796-1ade31b3516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.118376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cafc8f-2940-4e3b-8796-1ade31b3516f admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.118659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cafc8f-2940-4e3b-8796-1ade31b3516f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.118965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cafc8f-2940-4e3b-8796-1ade31b3516f admin admin] PATH_INFO: `/v3/projects/44ba6acec7824082a0705e83ab8b9142/users/7befd248778d441aa3a53bc17edc3380/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.134137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cafc8f-2940-4e3b-8796-1ade31b3516f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ba6acec7824082a0705e83ab8b9142, user_id=7befd248778d441aa3a53bc17edc3380, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.136821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cafc8f-2940-4e3b-8796-1ade31b3516f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.151574 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1288/2565] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:53 2022] PUT /identity/v3/projects/44ba6acec7824082a0705e83ab8b9142/users/7befd248778d441aa3a53bc17edc3380/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:53.161770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c14e0-2e48-4dca-b9cb-f3e7d18fee5c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.162263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c14e0-2e48-4dca-b9cb-f3e7d18fee5c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.162356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c14e0-2e48-4dca-b9cb-f3e7d18fee5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.188890 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c88c14e0-2e48-4dca-b9cb-f3e7d18fee5c None None] MFA Rules not processed for user `7befd248778d441aa3a53bc17edc3380`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:53.190092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c88c14e0-2e48-4dca-b9cb-f3e7d18fee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:53.209802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:53.256693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1278/2566] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:53.261249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cafc8f-2940-4e3b-8796-1ade31b3516f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:53.323818 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cafc8f-2940-4e3b-8796-1ade31b3516f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.328445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eb836-597d-44f2-9249-5ce4fe871d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.329095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb836-597d-44f2-9249-5ce4fe871d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.329378 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb836-597d-44f2-9249-5ce4fe871d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.329653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb836-597d-44f2-9249-5ce4fe871d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.330334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221eb836-597d-44f2-9249-5ce4fe871d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.332256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221eb836-597d-44f2-9249-5ce4fe871d41 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.342447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:53.358921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1289/2567] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:16:53 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:53.363025 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c14e0-2e48-4dca-b9cb-f3e7d18fee5c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:53.373451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c14e0-2e48-4dca-b9cb-f3e7d18fee5c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.429934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f76c1-11e1-4e0d-9248-1266c7eb2818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.430607 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f76c1-11e1-4e0d-9248-1266c7eb2818 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.430945 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f76c1-11e1-4e0d-9248-1266c7eb2818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.431197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f76c1-11e1-4e0d-9248-1266c7eb2818 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.431895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f76c1-11e1-4e0d-9248-1266c7eb2818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.433804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f76c1-11e1-4e0d-9248-1266c7eb2818 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.456493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1279/2568] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:16:53 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:53.457728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eb836-597d-44f2-9249-5ce4fe871d41 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:53.468541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eb836-597d-44f2-9249-5ce4fe871d41 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.473038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0cf05-f7d7-47ff-890f-b5c1c032bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.473684 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0cf05-f7d7-47ff-890f-b5c1c032bf97 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.473964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0cf05-f7d7-47ff-890f-b5c1c032bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.474238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0cf05-f7d7-47ff-890f-b5c1c032bf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.474981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0cf05-f7d7-47ff-890f-b5c1c032bf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.476566 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0cf05-f7d7-47ff-890f-b5c1c032bf97 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.486827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1290/2569] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:53.490762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f76c1-11e1-4e0d-9248-1266c7eb2818 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:53.500915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f76c1-11e1-4e0d-9248-1266c7eb2818 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.505771 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921757ef-d4b7-4316-bbbc-82327b955b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.506638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921757ef-d4b7-4316-bbbc-82327b955b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.506950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921757ef-d4b7-4316-bbbc-82327b955b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.507226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921757ef-d4b7-4316-bbbc-82327b955b17 admin admin] PATH_INFO: `/v3/projects/dc31ab924ea84c7da4a8ebaf413a382d/users/78c4603cd8114807a24fd2878978aff8/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.522761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921757ef-d4b7-4316-bbbc-82327b955b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc31ab924ea84c7da4a8ebaf413a382d, user_id=78c4603cd8114807a24fd2878978aff8, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.526080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921757ef-d4b7-4316-bbbc-82327b955b17 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.538923 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1280/2570] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:53 2022] PUT /identity/v3/projects/dc31ab924ea84c7da4a8ebaf413a382d/users/78c4603cd8114807a24fd2878978aff8/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:53.543095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0cf05-f7d7-47ff-890f-b5c1c032bf97 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:53.553226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0cf05-f7d7-47ff-890f-b5c1c032bf97 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.609853 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c51a8d-8bca-4410-9d54-ef2b0ad5196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.610516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c51a8d-8bca-4410-9d54-ef2b0ad5196f admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.610834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c51a8d-8bca-4410-9d54-ef2b0ad5196f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.611117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c51a8d-8bca-4410-9d54-ef2b0ad5196f admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.611835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c51a8d-8bca-4410-9d54-ef2b0ad5196f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.613479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c51a8d-8bca-4410-9d54-ef2b0ad5196f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.623529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1291/2571] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:53.627640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921757ef-d4b7-4316-bbbc-82327b955b17 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:53.638552 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921757ef-d4b7-4316-bbbc-82327b955b17 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.643120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2a3dc-ad65-405d-8186-654c7aa611bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.644025 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a3dc-ad65-405d-8186-654c7aa611bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.644305 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a3dc-ad65-405d-8186-654c7aa611bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.644579 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a3dc-ad65-405d-8186-654c7aa611bf admin admin] PATH_INFO: `/v3/projects/dc31ab924ea84c7da4a8ebaf413a382d/users/78c4603cd8114807a24fd2878978aff8/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.646528 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2a3dc-ad65-405d-8186-654c7aa611bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc31ab924ea84c7da4a8ebaf413a382d, user_id=78c4603cd8114807a24fd2878978aff8, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.649871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2a3dc-ad65-405d-8186-654c7aa611bf admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.661237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1281/2572] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:53 2022] PUT /identity/v3/projects/dc31ab924ea84c7da4a8ebaf413a382d/users/78c4603cd8114807a24fd2878978aff8/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:16:53.672882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826391-511e-4053-8d39-5793cc9b2c81 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.673173 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826391-511e-4053-8d39-5793cc9b2c81 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.673451 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826391-511e-4053-8d39-5793cc9b2c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.699821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-31826391-511e-4053-8d39-5793cc9b2c81 None None] MFA Rules not processed for user `78c4603cd8114807a24fd2878978aff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:53.701023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-31826391-511e-4053-8d39-5793cc9b2c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:53.768777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1292/2573] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:53.782059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2a3dc-ad65-405d-8186-654c7aa611bf admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:53.783789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-43f2a3dc-ad65-405d-8186-654c7aa611bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:53.844404 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2a3dc-ad65-405d-8186-654c7aa611bf admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:53.848096 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951681c8-e467-4367-bd3c-293e27e1b470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:53.848736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951681c8-e467-4367-bd3c-293e27e1b470 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:53.849020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951681c8-e467-4367-bd3c-293e27e1b470 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:53.849298 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951681c8-e467-4367-bd3c-293e27e1b470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:53.858457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951681c8-e467-4367-bd3c-293e27e1b470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:53.859973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951681c8-e467-4367-bd3c-293e27e1b470 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:53.869975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1282/2574] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:54.177407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31826391-511e-4053-8d39-5793cc9b2c81 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:54.187404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31826391-511e-4053-8d39-5793cc9b2c81 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:54.192057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98063927-53d8-47c5-860f-990e3fdf0734 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c4603cd8114807a24fd2878978aff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc31ab924ea84c7da4a8ebaf413a382d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:54.192715 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98063927-53d8-47c5-860f-990e3fdf0734 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:54.193005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98063927-53d8-47c5-860f-990e3fdf0734 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:54.193288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98063927-53d8-47c5-860f-990e3fdf0734 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:54.194026 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98063927-53d8-47c5-860f-990e3fdf0734 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:16:54.194352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98063927-53d8-47c5-860f-990e3fdf0734 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:54.196032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98063927-53d8-47c5-860f-990e3fdf0734 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:54.207426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1293/2575] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:16:54.211368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951681c8-e467-4367-bd3c-293e27e1b470 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:54.220705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951681c8-e467-4367-bd3c-293e27e1b470 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:54.225320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0273ad-9bb2-4627-9ea1-4d1a0ae103bf tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c4603cd8114807a24fd2878978aff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc31ab924ea84c7da4a8ebaf413a382d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:54.225964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0273ad-9bb2-4627-9ea1-4d1a0ae103bf tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:54.226254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0273ad-9bb2-4627-9ea1-4d1a0ae103bf tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:54.226551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0273ad-9bb2-4627-9ea1-4d1a0ae103bf tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:54.227802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0273ad-9bb2-4627-9ea1-4d1a0ae103bf tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:54.230132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0273ad-9bb2-4627-9ea1-4d1a0ae103bf tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:54.245372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:54.258739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1283/2576] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:16:54 2022] POST /identity/v3/projects => generated 352 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:54.263186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98063927-53d8-47c5-860f-990e3fdf0734 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:54.273707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98063927-53d8-47c5-860f-990e3fdf0734 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:54.320022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:54.332961 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf650d97-64bd-4143-b87c-b32a4d2ee5f0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c4603cd8114807a24fd2878978aff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc31ab924ea84c7da4a8ebaf413a382d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:54.333622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650d97-64bd-4143-b87c-b32a4d2ee5f0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:54.333915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650d97-64bd-4143-b87c-b32a4d2ee5f0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:54.334473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650d97-64bd-4143-b87c-b32a4d2ee5f0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:54.335235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf650d97-64bd-4143-b87c-b32a4d2ee5f0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:16:54.335551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf650d97-64bd-4143-b87c-b32a4d2ee5f0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:54.337492 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf650d97-64bd-4143-b87c-b32a4d2ee5f0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:54.348986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1294/2577] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:16:54.385888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0273ad-9bb2-4627-9ea1-4d1a0ae103bf tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:54.396254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0273ad-9bb2-4627-9ea1-4d1a0ae103bf tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:54.400958 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c4603cd8114807a24fd2878978aff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc31ab924ea84c7da4a8ebaf413a382d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:54.401802 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:54.402083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:54.402357 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] PATH_INFO: `/v3/projects/a164fc36f7374673a9538b2fc644378b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:54.403626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a164fc36f7374673a9538b2fc644378b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:54.405507 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:54.451813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a164fc36f7374673a9538b2fc644378b', 'request_id': 'req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:54.459048 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a164fc36f7374673a9538b2fc644378b', 'request_id': 'req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:54.465744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a164fc36f7374673a9538b2fc644378b', 'request_id': 'req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:54.475927 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] The token cache is being invalidate because project a164fc36f7374673a9538b2fc644378b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:54.476229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:54.476853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4806b9d9-db51-42a4-abcd-2eb3d31b03c0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:54.479000 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1284/2578] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:54 2022] DELETE /identity/v3/projects/a164fc36f7374673a9538b2fc644378b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:54.676493 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf650d97-64bd-4143-b87c-b32a4d2ee5f0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:54.678188 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cf650d97-64bd-4143-b87c-b32a4d2ee5f0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:54.746691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf650d97-64bd-4143-b87c-b32a4d2ee5f0 tempest-VolumeQuotaClassesTest-11054710 tempest-VolumeQuotaClassesTest-11054710-project-admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:54.806370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:54.807277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:54.807559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:54.807834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] PATH_INFO: `/v3/users/7befd248778d441aa3a53bc17edc3380` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:54.809044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] RBAC: Authorizing `identity:delete_user(user_id=7befd248778d441aa3a53bc17edc3380)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:54.811029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:54.863080 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7befd248778d441aa3a53bc17edc3380'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:54.863646 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7befd248778d441aa3a53bc17edc3380'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:54.870588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7befd248778d441aa3a53bc17edc3380'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:54.871263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7befd248778d441aa3a53bc17edc3380'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:54.883594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7befd248778d441aa3a53bc17edc3380'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:54.896611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1295/2579] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:16:54 2022] DELETE /identity/v3/users/7befd248778d441aa3a53bc17edc3380 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:54.904023 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fb24-87e7-4b99-a497-beee4362c3fa None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:54.904486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fb24-87e7-4b99-a497-beee4362c3fa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:54.904926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fb24-87e7-4b99-a497-beee4362c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:54.925098 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-26a2fb24-87e7-4b99-a497-beee4362c3fa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:54.926314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-26a2fb24-87e7-4b99-a497-beee4362c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:54.992859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1285/2580] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:55.004202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:55.005704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:55.018511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:55.074177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c7565-b4a7-4605-bf9b-103a97c5feda admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:55.077872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228d8e8-1944-4cd7-8f3f-6df1903beebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:55.078524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d8e8-1944-4cd7-8f3f-6df1903beebd service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:55.078843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d8e8-1944-4cd7-8f3f-6df1903beebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:55.079479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d8e8-1944-4cd7-8f3f-6df1903beebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:55.089671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228d8e8-1944-4cd7-8f3f-6df1903beebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:55.091175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228d8e8-1944-4cd7-8f3f-6df1903beebd service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:55.102637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1296/2581] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:55.419408 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fb24-87e7-4b99-a497-beee4362c3fa None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:55.420909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-26a2fb24-87e7-4b99-a497-beee4362c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:55.435694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fb24-87e7-4b99-a497-beee4362c3fa None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:55.441317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:55.442386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:55.442676 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:55.442984 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] PATH_INFO: `/v3/projects/44ba6acec7824082a0705e83ab8b9142` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:55.445396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ba6acec7824082a0705e83ab8b9142)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:55.456130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:55.512502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ba6acec7824082a0705e83ab8b9142', 'request_id': 'req-c3df845b-49d1-45b2-b35d-5422d02a3a97'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:55.526040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ba6acec7824082a0705e83ab8b9142', 'request_id': 'req-c3df845b-49d1-45b2-b35d-5422d02a3a97'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:55.534082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ba6acec7824082a0705e83ab8b9142', 'request_id': 'req-c3df845b-49d1-45b2-b35d-5422d02a3a97'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:55.546748 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] The token cache is being invalidate because project 44ba6acec7824082a0705e83ab8b9142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:55.547149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:55.547839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:55.552571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1286/2582] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:55 2022] DELETE /identity/v3/projects/44ba6acec7824082a0705e83ab8b9142 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:16:55.553750 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228d8e8-1944-4cd7-8f3f-6df1903beebd service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:55.566501 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228d8e8-1944-4cd7-8f3f-6df1903beebd service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:55.633386 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:55.635336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:55.635821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:55.636243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] PATH_INFO: `/v3/users/78c4603cd8114807a24fd2878978aff8` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:55.637736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c4603cd8114807a24fd2878978aff8)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:55.640124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:55.687249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c4603cd8114807a24fd2878978aff8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:55.687873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c4603cd8114807a24fd2878978aff8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:55.694620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c4603cd8114807a24fd2878978aff8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:55.695274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c4603cd8114807a24fd2878978aff8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:55.706790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5ef115d6-518a-4ba8-b184-e2fce54cdc10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c4603cd8114807a24fd2878978aff8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:55.719580 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1297/2583] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:16:55 2022] DELETE /identity/v3/users/78c4603cd8114807a24fd2878978aff8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:16:55.990730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:55.992564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:56.003879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:56.009751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df845b-49d1-45b2-b35d-5422d02a3a97 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.070955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.071954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.072239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.072520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] PATH_INFO: `/v3/projects/dc31ab924ea84c7da4a8ebaf413a382d` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.073687 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc31ab924ea84c7da4a8ebaf413a382d)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.075754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.121876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc31ab924ea84c7da4a8ebaf413a382d', 'request_id': 'req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:56.128786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc31ab924ea84c7da4a8ebaf413a382d', 'request_id': 'req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:56.135029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc31ab924ea84c7da4a8ebaf413a382d', 'request_id': 'req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:56.145214 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] The token cache is being invalidate because project dc31ab924ea84c7da4a8ebaf413a382d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:16:56.145503 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:56.146129 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7dd1e8ed-fe62-4991-a3db-44b5ba8d51fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:16:56.147723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1287/2584] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:16:55 2022] DELETE /identity/v3/projects/dc31ab924ea84c7da4a8ebaf413a382d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:56.153231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ea8a1-2d9d-46c7-a1ac-ce1d21f8f6f9 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.153567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ea8a1-2d9d-46c7-a1ac-ce1d21f8f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.153912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ea8a1-2d9d-46c7-a1ac-ce1d21f8f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.174966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-ff2ea8a1-2d9d-46c7-a1ac-ce1d21f8f6f9 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:56.176155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-ff2ea8a1-2d9d-46c7-a1ac-ce1d21f8f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:56.201095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:56.242324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1298/2585] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:16:56.250683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceded86-34b6-426d-8509-3454f3518f02 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.250910 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceded86-34b6-426d-8509-3454f3518f02 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.251145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceded86-34b6-426d-8509-3454f3518f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.269879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bceded86-34b6-426d-8509-3454f3518f02 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:56.271145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bceded86-34b6-426d-8509-3454f3518f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:56.279759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1288/2586] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:56.283903 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ea8a1-2d9d-46c7-a1ac-ce1d21f8f6f9 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.294365 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ea8a1-2d9d-46c7-a1ac-ce1d21f8f6f9 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.298844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386d2d-62cf-461a-b1c0-f6fb06058b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.299489 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386d2d-62cf-461a-b1c0-f6fb06058b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.299767 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386d2d-62cf-461a-b1c0-f6fb06058b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.300040 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386d2d-62cf-461a-b1c0-f6fb06058b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.300784 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386d2d-62cf-461a-b1c0-f6fb06058b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:16:56.301086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386d2d-62cf-461a-b1c0-f6fb06058b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.302658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386d2d-62cf-461a-b1c0-f6fb06058b04 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.314287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1299/2587] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:16:56.318497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceded86-34b6-426d-8509-3454f3518f02 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.327660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceded86-34b6-426d-8509-3454f3518f02 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.332267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392cede-55d7-433a-afb4-981cd29e9b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.332960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392cede-55d7-433a-afb4-981cd29e9b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.333249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392cede-55d7-433a-afb4-981cd29e9b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.333528 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392cede-55d7-433a-afb4-981cd29e9b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.334221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392cede-55d7-433a-afb4-981cd29e9b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.336131 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392cede-55d7-433a-afb4-981cd29e9b49 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.362164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1289/2588] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:16:56 2022] POST /identity/v3/projects => generated 409 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:56.366276 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386d2d-62cf-461a-b1c0-f6fb06058b04 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.376500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386d2d-62cf-461a-b1c0-f6fb06058b04 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.433224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f9495-3937-4b68-a730-b546652c33a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.433917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f9495-3937-4b68-a730-b546652c33a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.434202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f9495-3937-4b68-a730-b546652c33a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.434476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f9495-3937-4b68-a730-b546652c33a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.435198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f9495-3937-4b68-a730-b546652c33a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.437094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f9495-3937-4b68-a730-b546652c33a5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.459177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1300/2589] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:16:56 2022] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:56.463854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392cede-55d7-433a-afb4-981cd29e9b49 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.473961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392cede-55d7-433a-afb4-981cd29e9b49 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.478602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a2508-712d-4d69-83d4-63f5ec534b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.479278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a2508-712d-4d69-83d4-63f5ec534b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.479561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a2508-712d-4d69-83d4-63f5ec534b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.479837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a2508-712d-4d69-83d4-63f5ec534b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.480557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a2508-712d-4d69-83d4-63f5ec534b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.482136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a2508-712d-4d69-83d4-63f5ec534b03 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.492405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1290/2590] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:56.496318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f9495-3937-4b68-a730-b546652c33a5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.506313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f9495-3937-4b68-a730-b546652c33a5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.511524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a04d5-05c6-4ca8-a036-cba602107b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.512185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a04d5-05c6-4ca8-a036-cba602107b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.512464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a04d5-05c6-4ca8-a036-cba602107b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.512737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a04d5-05c6-4ca8-a036-cba602107b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.513454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a04d5-05c6-4ca8-a036-cba602107b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.515069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a04d5-05c6-4ca8-a036-cba602107b93 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.527376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1301/2591] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:56.531685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a2508-712d-4d69-83d4-63f5ec534b03 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.541964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a2508-712d-4d69-83d4-63f5ec534b03 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.546462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b378e87-3768-4c04-b8d9-3b558188e492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.547360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378e87-3768-4c04-b8d9-3b558188e492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.547642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378e87-3768-4c04-b8d9-3b558188e492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.547921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378e87-3768-4c04-b8d9-3b558188e492 admin admin] PATH_INFO: `/v3/projects/6b0d4d203c344dd683e1b78a20bfb394/users/fc3270ca623b4362bef70ecb5867e0ea/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.562207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b378e87-3768-4c04-b8d9-3b558188e492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0d4d203c344dd683e1b78a20bfb394, user_id=fc3270ca623b4362bef70ecb5867e0ea, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.564861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b378e87-3768-4c04-b8d9-3b558188e492 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.577947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1291/2592] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:56 2022] PUT /identity/v3/projects/6b0d4d203c344dd683e1b78a20bfb394/users/fc3270ca623b4362bef70ecb5867e0ea/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:56.589217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e7983-b7ff-4cae-b5f7-6715461b65b0 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.589639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e7983-b7ff-4cae-b5f7-6715461b65b0 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.589921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e7983-b7ff-4cae-b5f7-6715461b65b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.616939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d35e7983-b7ff-4cae-b5f7-6715461b65b0 None None] MFA Rules not processed for user `fc3270ca623b4362bef70ecb5867e0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:56.618155 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d35e7983-b7ff-4cae-b5f7-6715461b65b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:56.682605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1302/2593] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:56.687113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b378e87-3768-4c04-b8d9-3b558188e492 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.719075 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:56.752619 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b378e87-3768-4c04-b8d9-3b558188e492 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.757392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24737f-2645-4393-92da-ceb7b78eb130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.758067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24737f-2645-4393-92da-ceb7b78eb130 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.758350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24737f-2645-4393-92da-ceb7b78eb130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.759139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24737f-2645-4393-92da-ceb7b78eb130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.760088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24737f-2645-4393-92da-ceb7b78eb130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.762111 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24737f-2645-4393-92da-ceb7b78eb130 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.789166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1292/2594] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:16:56 2022] POST /identity/v3/projects => generated 409 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:16:56.793231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e7983-b7ff-4cae-b5f7-6715461b65b0 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.803839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e7983-b7ff-4cae-b5f7-6715461b65b0 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.829899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:56.862374 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd276d81-da6f-4a33-9015-5c709fe780ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.863092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd276d81-da6f-4a33-9015-5c709fe780ce admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.863491 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd276d81-da6f-4a33-9015-5c709fe780ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.863852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd276d81-da6f-4a33-9015-5c709fe780ce admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.864544 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd276d81-da6f-4a33-9015-5c709fe780ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.866517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd276d81-da6f-4a33-9015-5c709fe780ce admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.886513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1303/2595] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:16:56 2022] POST /identity/v3/users => generated 311 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:16:56.890485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24737f-2645-4393-92da-ceb7b78eb130 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.900691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24737f-2645-4393-92da-ceb7b78eb130 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.905277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7a966-53e9-4dd7-b8b5-1e4944a560ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.905931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7a966-53e9-4dd7-b8b5-1e4944a560ec admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.906216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7a966-53e9-4dd7-b8b5-1e4944a560ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.906491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7a966-53e9-4dd7-b8b5-1e4944a560ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.907240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7a966-53e9-4dd7-b8b5-1e4944a560ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.908818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7a966-53e9-4dd7-b8b5-1e4944a560ec admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.925785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1293/2596] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:16:56.930134 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd276d81-da6f-4a33-9015-5c709fe780ce admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.941154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd276d81-da6f-4a33-9015-5c709fe780ce admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:56.945675 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0954480-1970-42e3-a75c-b6e279a4acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:56.947808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0954480-1970-42e3-a75c-b6e279a4acc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:56.948092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0954480-1970-42e3-a75c-b6e279a4acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:56.948366 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0954480-1970-42e3-a75c-b6e279a4acc9 admin admin] PATH_INFO: `/v3/projects/b35731610070452883d41285062f40bd/users/236d4fb8d0424308bd3e153f3f955e8e/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:56.963258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0954480-1970-42e3-a75c-b6e279a4acc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35731610070452883d41285062f40bd, user_id=236d4fb8d0424308bd3e153f3f955e8e, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:56.965945 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0954480-1970-42e3-a75c-b6e279a4acc9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:56.978476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1304/2597] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:56 2022] PUT /identity/v3/projects/b35731610070452883d41285062f40bd/users/236d4fb8d0424308bd3e153f3f955e8e/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:56.982422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7a966-53e9-4dd7-b8b5-1e4944a560ec admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:56.992867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7a966-53e9-4dd7-b8b5-1e4944a560ec admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:57.049694 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa4d1e-4fec-4258-bb6c-f34fcc46a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:57.050277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa4d1e-4fec-4258-bb6c-f34fcc46a1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:57.050561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa4d1e-4fec-4258-bb6c-f34fcc46a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:57.050869 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa4d1e-4fec-4258-bb6c-f34fcc46a1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:57.051594 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa4d1e-4fec-4258-bb6c-f34fcc46a1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:57.053179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa4d1e-4fec-4258-bb6c-f34fcc46a1d4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:57.063601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1294/2598] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:16:57.067742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0954480-1970-42e3-a75c-b6e279a4acc9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:57.078530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0954480-1970-42e3-a75c-b6e279a4acc9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:57.083190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a09c-cd6e-4068-88c1-4623579a55ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:57.084098 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a09c-cd6e-4068-88c1-4623579a55ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:57.084382 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a09c-cd6e-4068-88c1-4623579a55ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:57.084661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a09c-cd6e-4068-88c1-4623579a55ad admin admin] PATH_INFO: `/v3/projects/b35731610070452883d41285062f40bd/users/236d4fb8d0424308bd3e153f3f955e8e/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:57.086617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242a09c-cd6e-4068-88c1-4623579a55ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35731610070452883d41285062f40bd, user_id=236d4fb8d0424308bd3e153f3f955e8e, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:57.089516 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242a09c-cd6e-4068-88c1-4623579a55ad admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:57.099944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1305/2599] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:16:57 2022] PUT /identity/v3/projects/b35731610070452883d41285062f40bd/users/236d4fb8d0424308bd3e153f3f955e8e/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:16:57.111122 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5722-a9cf-4ca6-9752-bc82e685a509 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:57.111414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5722-a9cf-4ca6-9752-bc82e685a509 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:57.111691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5722-a9cf-4ca6-9752-bc82e685a509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:57.141825 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-59de5722-a9cf-4ca6-9752-bc82e685a509 None None] MFA Rules not processed for user `236d4fb8d0424308bd3e153f3f955e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:16:57.143094 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-59de5722-a9cf-4ca6-9752-bc82e685a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:57.214640 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1295/2600] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:16:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:16:57.225590 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a09c-cd6e-4068-88c1-4623579a55ad admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:57.227330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9242a09c-cd6e-4068-88c1-4623579a55ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:16:57.286773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a09c-cd6e-4068-88c1-4623579a55ad admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:57.291150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207b733-7dca-4999-be41-9c6f65d7ce60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:57.291821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207b733-7dca-4999-be41-9c6f65d7ce60 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:57.292106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207b733-7dca-4999-be41-9c6f65d7ce60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:57.292388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207b733-7dca-4999-be41-9c6f65d7ce60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:57.301773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207b733-7dca-4999-be41-9c6f65d7ce60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:57.303224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207b733-7dca-4999-be41-9c6f65d7ce60 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:57.313724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1306/2601] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:16:57.477770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de5722-a9cf-4ca6-9752-bc82e685a509 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:16:57.487667 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de5722-a9cf-4ca6-9752-bc82e685a509 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:16:57.491249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48359330-721b-40cb-9ef3-dd984ced8759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:16:57.491977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359330-721b-40cb-9ef3-dd984ced8759 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:16:57.492325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359330-721b-40cb-9ef3-dd984ced8759 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:16:57.492665 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359330-721b-40cb-9ef3-dd984ced8759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:16:57.520253 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:16:57.560989 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48359330-721b-40cb-9ef3-dd984ced8759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:16:57.562445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48359330-721b-40cb-9ef3-dd984ced8759 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:16:57.572447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1296/2602] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:16:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:17:06.932411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207b733-7dca-4999-be41-9c6f65d7ce60 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:07.005657 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207b733-7dca-4999-be41-9c6f65d7ce60 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:07.010634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:07.011524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:07.011803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:07.012072 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] PATH_INFO: `/v3/users/fc3270ca623b4362bef70ecb5867e0ea` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:07.013236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3270ca623b4362bef70ecb5867e0ea)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:07.015195 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:07.037809 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:07.063196 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3270ca623b4362bef70ecb5867e0ea'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.063838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3270ca623b4362bef70ecb5867e0ea'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.070778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3270ca623b4362bef70ecb5867e0ea'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.071403 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3270ca623b4362bef70ecb5867e0ea'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.083793 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3270ca623b4362bef70ecb5867e0ea'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.098258 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1307/2603] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:17:06 2022] DELETE /identity/v3/users/fc3270ca623b4362bef70ecb5867e0ea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:07.102810 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f907-8572-4811-add7-fd6ea0c58c4a None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:07.103260 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f907-8572-4811-add7-fd6ea0c58c4a None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:07.103403 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f907-8572-4811-add7-fd6ea0c58c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:07.120417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-3860f907-8572-4811-add7-fd6ea0c58c4a None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:07.121633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3860f907-8572-4811-add7-fd6ea0c58c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:07.183790 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1297/2604] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:17:07.193265 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:07.194645 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:07.252295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0a0cf-5839-497c-80ad-0e776437ad49 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:07.256209 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074c78a-f6bf-4d54-bcd4-de8183adad1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:07.256850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074c78a-f6bf-4d54-bcd4-de8183adad1d service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:07.257133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074c78a-f6bf-4d54-bcd4-de8183adad1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:07.257408 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074c78a-f6bf-4d54-bcd4-de8183adad1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:07.267556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074c78a-f6bf-4d54-bcd4-de8183adad1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:07.268980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074c78a-f6bf-4d54-bcd4-de8183adad1d service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:07.278591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1308/2605] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:17:07.555812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f907-8572-4811-add7-fd6ea0c58c4a None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:07.557396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3860f907-8572-4811-add7-fd6ea0c58c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:07.570392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f907-8572-4811-add7-fd6ea0c58c4a None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:07.575458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:07.576322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:07.576604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:07.576879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] PATH_INFO: `/v3/projects/6b0d4d203c344dd683e1b78a20bfb394` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:07.578059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0d4d203c344dd683e1b78a20bfb394)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:07.579995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:07.626089 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0d4d203c344dd683e1b78a20bfb394', 'request_id': 'req-eaaaa3fa-028d-49e1-90e8-733c344efb20'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.634838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0d4d203c344dd683e1b78a20bfb394', 'request_id': 'req-eaaaa3fa-028d-49e1-90e8-733c344efb20'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.641589 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0d4d203c344dd683e1b78a20bfb394', 'request_id': 'req-eaaaa3fa-028d-49e1-90e8-733c344efb20'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.652365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] The token cache is being invalidate because project 6b0d4d203c344dd683e1b78a20bfb394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:17:07.652653 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.653284 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.654855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1298/2606] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:17:07 2022] DELETE /identity/v3/projects/6b0d4d203c344dd683e1b78a20bfb394 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:17:07.658824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074c78a-f6bf-4d54-bcd4-de8183adad1d service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:07.668456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074c78a-f6bf-4d54-bcd4-de8183adad1d service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:07.724492 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:07.725367 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:07.725654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:07.725931 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] PATH_INFO: `/v3/users/236d4fb8d0424308bd3e153f3f955e8e` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:07.727148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=236d4fb8d0424308bd3e153f3f955e8e)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:07.729062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:07.773553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:07.775320 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236d4fb8d0424308bd3e153f3f955e8e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.776210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236d4fb8d0424308bd3e153f3f955e8e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.785373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236d4fb8d0424308bd3e153f3f955e8e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.786012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236d4fb8d0424308bd3e153f3f955e8e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.798216 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f9a2255b-bc72-4bb9-b601-1e7d13edea0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236d4fb8d0424308bd3e153f3f955e8e'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:07.811266 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1309/2607] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:17:07 2022] DELETE /identity/v3/users/236d4fb8d0424308bd3e153f3f955e8e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:08.105555 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:08.108022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:08.122495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaa3fa-028d-49e1-90e8-733c344efb20 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:08.172812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:08.192793 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:08.193684 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.193966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.194241 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] PATH_INFO: `/v3/projects/b35731610070452883d41285062f40bd` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.195397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35731610070452883d41285062f40bd)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:08.197291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:08.243393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35731610070452883d41285062f40bd', 'request_id': 'req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:08.250512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35731610070452883d41285062f40bd', 'request_id': 'req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:08.256936 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35731610070452883d41285062f40bd', 'request_id': 'req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:08.267448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] The token cache is being invalidate because project b35731610070452883d41285062f40bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:17:08.267732 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:08.268568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-69fdf081-7a91-4dea-b6bf-9e7be0249b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:08.270411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1299/2608] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:17:08 2022] DELETE /identity/v3/projects/b35731610070452883d41285062f40bd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:17:08.275187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9128a5-3941-417c-8698-8799442b1eaf None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.276207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9128a5-3941-417c-8698-8799442b1eaf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.276421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9128a5-3941-417c-8698-8799442b1eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.294661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1a9128a5-3941-417c-8698-8799442b1eaf None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:08.295891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1a9128a5-3941-417c-8698-8799442b1eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:08.360009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1310/2609] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:08.367745 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ad55-ee55-4270-9d73-9568deac6770 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.368040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ad55-ee55-4270-9d73-9568deac6770 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.368349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ad55-ee55-4270-9d73-9568deac6770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.387917 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ee57ad55-ee55-4270-9d73-9568deac6770 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:08.389117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ee57ad55-ee55-4270-9d73-9568deac6770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:08.397045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1300/2610] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:08.402178 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9128a5-3941-417c-8698-8799442b1eaf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:08.412212 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9128a5-3941-417c-8698-8799442b1eaf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:08.417714 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415bdd-c406-4812-b317-ffc4c3eeec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:08.418363 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415bdd-c406-4812-b317-ffc4c3eeec46 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.418646 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415bdd-c406-4812-b317-ffc4c3eeec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.418951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415bdd-c406-4812-b317-ffc4c3eeec46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.419672 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3415bdd-c406-4812-b317-ffc4c3eeec46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:17:08.420003 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3415bdd-c406-4812-b317-ffc4c3eeec46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:08.421587 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3415bdd-c406-4812-b317-ffc4c3eeec46 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:08.433611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1311/2611] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:17:08.438008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57ad55-ee55-4270-9d73-9568deac6770 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:08.447343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57ad55-ee55-4270-9d73-9568deac6770 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:08.452635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217e177-0667-47e7-adc3-a4763968bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:08.453281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217e177-0667-47e7-adc3-a4763968bc39 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.453565 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217e177-0667-47e7-adc3-a4763968bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.453841 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217e177-0667-47e7-adc3-a4763968bc39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.454527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217e177-0667-47e7-adc3-a4763968bc39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:08.456457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217e177-0667-47e7-adc3-a4763968bc39 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:08.482147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1301/2612] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:17:08 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:17:08.486191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415bdd-c406-4812-b317-ffc4c3eeec46 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:08.496231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415bdd-c406-4812-b317-ffc4c3eeec46 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:08.554406 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119ccd-175f-4c19-9428-afc08e71804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:08.555095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119ccd-175f-4c19-9428-afc08e71804c admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.555379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119ccd-175f-4c19-9428-afc08e71804c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.555653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119ccd-175f-4c19-9428-afc08e71804c admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.556336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119ccd-175f-4c19-9428-afc08e71804c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:08.558667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119ccd-175f-4c19-9428-afc08e71804c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:08.578053 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1312/2613] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:17:08 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:17:08.582150 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217e177-0667-47e7-adc3-a4763968bc39 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:08.592892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217e177-0667-47e7-adc3-a4763968bc39 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:08.597386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab6cbd-ec45-461a-a38d-412b640146b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:08.598031 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab6cbd-ec45-461a-a38d-412b640146b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.598310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab6cbd-ec45-461a-a38d-412b640146b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.598581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab6cbd-ec45-461a-a38d-412b640146b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.599329 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab6cbd-ec45-461a-a38d-412b640146b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:08.600933 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab6cbd-ec45-461a-a38d-412b640146b1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:08.611315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1302/2614] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:17:08.615028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119ccd-175f-4c19-9428-afc08e71804c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:08.624851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119ccd-175f-4c19-9428-afc08e71804c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:08.629730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761368b-72b7-4604-aa81-34b2b1c3fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:08.630381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761368b-72b7-4604-aa81-34b2b1c3fe74 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.630666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761368b-72b7-4604-aa81-34b2b1c3fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.630975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761368b-72b7-4604-aa81-34b2b1c3fe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.631696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761368b-72b7-4604-aa81-34b2b1c3fe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:08.633274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761368b-72b7-4604-aa81-34b2b1c3fe74 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:08.643586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1313/2615] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:17:08.647422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab6cbd-ec45-461a-a38d-412b640146b1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:08.657758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab6cbd-ec45-461a-a38d-412b640146b1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:08.662263 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32a7e5-269f-48e9-8aab-b7c6b897e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:08.663156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32a7e5-269f-48e9-8aab-b7c6b897e8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.663438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32a7e5-269f-48e9-8aab-b7c6b897e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.663711 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32a7e5-269f-48e9-8aab-b7c6b897e8dc admin admin] PATH_INFO: `/v3/projects/7e07c2d9ef184635bb6159c1f39f8210/users/76a98871ca764d1caa56b5760e38c6e6/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.677910 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32a7e5-269f-48e9-8aab-b7c6b897e8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e07c2d9ef184635bb6159c1f39f8210, user_id=76a98871ca764d1caa56b5760e38c6e6, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:08.680556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32a7e5-269f-48e9-8aab-b7c6b897e8dc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:08.693019 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1303/2616] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:17:08 2022] PUT /identity/v3/projects/7e07c2d9ef184635bb6159c1f39f8210/users/76a98871ca764d1caa56b5760e38c6e6/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:08.704851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d4ab-12af-4248-8e81-524df7bdbe37 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.705142 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d4ab-12af-4248-8e81-524df7bdbe37 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.705420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d4ab-12af-4248-8e81-524df7bdbe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.732023 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-fb45d4ab-12af-4248-8e81-524df7bdbe37 None None] MFA Rules not processed for user `76a98871ca764d1caa56b5760e38c6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:08.733221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fb45d4ab-12af-4248-8e81-524df7bdbe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:08.749877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:08.798775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1314/2617] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:08.803203 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32a7e5-269f-48e9-8aab-b7c6b897e8dc admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:08.863651 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32a7e5-269f-48e9-8aab-b7c6b897e8dc admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:08.868132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08ee8b-6ef6-4137-a2bd-f41a314a4317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:08.868781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08ee8b-6ef6-4137-a2bd-f41a314a4317 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.869066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08ee8b-6ef6-4137-a2bd-f41a314a4317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.869345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08ee8b-6ef6-4137-a2bd-f41a314a4317 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.870570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08ee8b-6ef6-4137-a2bd-f41a314a4317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:08.872486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08ee8b-6ef6-4137-a2bd-f41a314a4317 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:08.891226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:08.902017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1304/2618] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:17:08 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:17:08.903193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d4ab-12af-4248-8e81-524df7bdbe37 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:08.913782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d4ab-12af-4248-8e81-524df7bdbe37 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:08.970146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efc67d-50a5-4ad6-a164-e0226767ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:08.970840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efc67d-50a5-4ad6-a164-e0226767ec73 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:08.971121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efc67d-50a5-4ad6-a164-e0226767ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:08.971394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efc67d-50a5-4ad6-a164-e0226767ec73 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:08.972075 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efc67d-50a5-4ad6-a164-e0226767ec73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:08.973973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efc67d-50a5-4ad6-a164-e0226767ec73 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:08.998555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1315/2619] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:17:08 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:17:09.001617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08ee8b-6ef6-4137-a2bd-f41a314a4317 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:09.012669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08ee8b-6ef6-4137-a2bd-f41a314a4317 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:09.017268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079dc00-053e-488d-b79b-cfff453b1602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:09.017920 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079dc00-053e-488d-b79b-cfff453b1602 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:09.018208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079dc00-053e-488d-b79b-cfff453b1602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:09.018488 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079dc00-053e-488d-b79b-cfff453b1602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:09.019257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079dc00-053e-488d-b79b-cfff453b1602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:09.020844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079dc00-053e-488d-b79b-cfff453b1602 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:09.031388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1305/2620] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:17:09.035336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efc67d-50a5-4ad6-a164-e0226767ec73 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:09.045723 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efc67d-50a5-4ad6-a164-e0226767ec73 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:09.050424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1203677-fb32-448d-a2fb-1ce598daa3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:09.051483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1203677-fb32-448d-a2fb-1ce598daa3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:09.051773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1203677-fb32-448d-a2fb-1ce598daa3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:09.052177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1203677-fb32-448d-a2fb-1ce598daa3ac admin admin] PATH_INFO: `/v3/projects/94d7263467d84d58abcfa86e3925067a/users/0a0d26b76f214b9a8bb4dc8e0a10278f/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:09.069479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1203677-fb32-448d-a2fb-1ce598daa3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d7263467d84d58abcfa86e3925067a, user_id=0a0d26b76f214b9a8bb4dc8e0a10278f, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:09.072413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1203677-fb32-448d-a2fb-1ce598daa3ac admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:09.085346 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1316/2621] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:17:09 2022] PUT /identity/v3/projects/94d7263467d84d58abcfa86e3925067a/users/0a0d26b76f214b9a8bb4dc8e0a10278f/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:09.089277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079dc00-053e-488d-b79b-cfff453b1602 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:09.099240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079dc00-053e-488d-b79b-cfff453b1602 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:09.155820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ac5b5-9ad7-48f4-97cb-92029bb78ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:09.156487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ac5b5-9ad7-48f4-97cb-92029bb78ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:09.156776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ac5b5-9ad7-48f4-97cb-92029bb78ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:09.157054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ac5b5-9ad7-48f4-97cb-92029bb78ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:09.157777 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ac5b5-9ad7-48f4-97cb-92029bb78ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:09.159419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ac5b5-9ad7-48f4-97cb-92029bb78ef9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:09.169858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1306/2622] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:17:09.173927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1203677-fb32-448d-a2fb-1ce598daa3ac admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:09.184292 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1203677-fb32-448d-a2fb-1ce598daa3ac admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:09.189085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb989b-21cc-438f-9759-76e69ba166c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:09.190030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb989b-21cc-438f-9759-76e69ba166c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:09.190316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb989b-21cc-438f-9759-76e69ba166c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:09.190591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb989b-21cc-438f-9759-76e69ba166c4 admin admin] PATH_INFO: `/v3/projects/94d7263467d84d58abcfa86e3925067a/users/0a0d26b76f214b9a8bb4dc8e0a10278f/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:09.192618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb989b-21cc-438f-9759-76e69ba166c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d7263467d84d58abcfa86e3925067a, user_id=0a0d26b76f214b9a8bb4dc8e0a10278f, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:09.195532 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb989b-21cc-438f-9759-76e69ba166c4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:09.207152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1317/2623] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:17:09 2022] PUT /identity/v3/projects/94d7263467d84d58abcfa86e3925067a/users/0a0d26b76f214b9a8bb4dc8e0a10278f/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:09.218184 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f925229-450c-407a-8f45-fc475ab3d8d2 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:09.218480 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f925229-450c-407a-8f45-fc475ab3d8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:09.218819 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f925229-450c-407a-8f45-fc475ab3d8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:09.249682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0f925229-450c-407a-8f45-fc475ab3d8d2 None None] MFA Rules not processed for user `0a0d26b76f214b9a8bb4dc8e0a10278f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:09.250961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0f925229-450c-407a-8f45-fc475ab3d8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:09.322113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1307/2624] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:17:09.334184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb989b-21cc-438f-9759-76e69ba166c4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:09.336106 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-23bb989b-21cc-438f-9759-76e69ba166c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:09.397498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb989b-21cc-438f-9759-76e69ba166c4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:09.402564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457cb94-fa96-450d-be8c-7e566398c8c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:09.403892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457cb94-fa96-450d-be8c-7e566398c8c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:09.404372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457cb94-fa96-450d-be8c-7e566398c8c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:09.404755 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457cb94-fa96-450d-be8c-7e566398c8c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:09.418938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457cb94-fa96-450d-be8c-7e566398c8c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:09.420379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457cb94-fa96-450d-be8c-7e566398c8c6 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:09.429880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1318/2625] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:17:09.515473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f925229-450c-407a-8f45-fc475ab3d8d2 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:09.525088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f925229-450c-407a-8f45-fc475ab3d8d2 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:09.528908 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96e5d6-8ec2-4ca7-90fc-de3b41a3f847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:09.529540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e5d6-8ec2-4ca7-90fc-de3b41a3f847 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:09.529860 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e5d6-8ec2-4ca7-90fc-de3b41a3f847 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:09.530143 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e5d6-8ec2-4ca7-90fc-de3b41a3f847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:09.587016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96e5d6-8ec2-4ca7-90fc-de3b41a3f847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:09.588471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96e5d6-8ec2-4ca7-90fc-de3b41a3f847 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:09.597404 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1308/2626] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:17:14.257887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457cb94-fa96-450d-be8c-7e566398c8c6 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:14.271460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:14.320664 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457cb94-fa96-450d-be8c-7e566398c8c6 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:14.325906 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:14.326801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:14.327086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:14.327359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] PATH_INFO: `/v3/users/76a98871ca764d1caa56b5760e38c6e6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:14.328529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a98871ca764d1caa56b5760e38c6e6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:14.330437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:14.375978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a98871ca764d1caa56b5760e38c6e6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:14.376556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a98871ca764d1caa56b5760e38c6e6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:14.383965 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a98871ca764d1caa56b5760e38c6e6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:14.384594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a98871ca764d1caa56b5760e38c6e6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:14.397322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a98871ca764d1caa56b5760e38c6e6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:14.411043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1319/2627] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:17:14 2022] DELETE /identity/v3/users/76a98871ca764d1caa56b5760e38c6e6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:14.415971 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4739a1-27e7-459d-995f-52601dc616d1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:14.416494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4739a1-27e7-459d-995f-52601dc616d1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:14.416598 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4739a1-27e7-459d-995f-52601dc616d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:14.428353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:14.434539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-0d4739a1-27e7-459d-995f-52601dc616d1 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:14.435832 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0d4739a1-27e7-459d-995f-52601dc616d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:14.497874 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1309/2628] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:17:14.507737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:14.509279 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:14.567783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393ba70-3e33-47f4-ba29-98e262e353c7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:14.571449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042b132-ab58-42f3-92cf-c1f72102ab80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:14.572094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042b132-ab58-42f3-92cf-c1f72102ab80 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:14.572379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042b132-ab58-42f3-92cf-c1f72102ab80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:14.573189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042b132-ab58-42f3-92cf-c1f72102ab80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:14.582341 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042b132-ab58-42f3-92cf-c1f72102ab80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:14.583817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042b132-ab58-42f3-92cf-c1f72102ab80 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:14.594059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1320/2629] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:17:15.098195 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4739a1-27e7-459d-995f-52601dc616d1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:15.099600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-0d4739a1-27e7-459d-995f-52601dc616d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:15.114473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4739a1-27e7-459d-995f-52601dc616d1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:15.120057 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:15.120952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:15.121233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:15.121506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] PATH_INFO: `/v3/projects/7e07c2d9ef184635bb6159c1f39f8210` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:15.122799 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e07c2d9ef184635bb6159c1f39f8210)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:15.124820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:15.176918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e07c2d9ef184635bb6159c1f39f8210', 'request_id': 'req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.185547 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e07c2d9ef184635bb6159c1f39f8210', 'request_id': 'req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.192020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e07c2d9ef184635bb6159c1f39f8210', 'request_id': 'req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.203786 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] The token cache is being invalidate because project 7e07c2d9ef184635bb6159c1f39f8210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:17:15.204078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.204744 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.206290 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1310/2630] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:17:15 2022] DELETE /identity/v3/projects/7e07c2d9ef184635bb6159c1f39f8210 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:17:15.210236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042b132-ab58-42f3-92cf-c1f72102ab80 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:15.220159 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042b132-ab58-42f3-92cf-c1f72102ab80 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:15.253943 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:15.281436 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:15.282315 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:15.282599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:15.283021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] PATH_INFO: `/v3/users/0a0d26b76f214b9a8bb4dc8e0a10278f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:15.284126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0d26b76f214b9a8bb4dc8e0a10278f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:15.286057 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:15.333952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0d26b76f214b9a8bb4dc8e0a10278f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.334597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0d26b76f214b9a8bb4dc8e0a10278f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.341565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0d26b76f214b9a8bb4dc8e0a10278f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.342189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0d26b76f214b9a8bb4dc8e0a10278f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.354237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fcfee16e-1080-433a-b2df-73f55f81d5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0d26b76f214b9a8bb4dc8e0a10278f'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.366757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1321/2631] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:17:15 2022] DELETE /identity/v3/users/0a0d26b76f214b9a8bb4dc8e0a10278f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:15.647409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:15.648944 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:15.664033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85285cb-4d6a-4e6b-8197-b5cd32fadf5d admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:15.724760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:15.725547 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:15.725831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:15.726105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] PATH_INFO: `/v3/projects/94d7263467d84d58abcfa86e3925067a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:15.727318 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d7263467d84d58abcfa86e3925067a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:15.729821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:15.769756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:15.784783 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d7263467d84d58abcfa86e3925067a', 'request_id': 'req-a5cc2e68-ab54-42e3-be49-28dc1f935335'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.792611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d7263467d84d58abcfa86e3925067a', 'request_id': 'req-a5cc2e68-ab54-42e3-be49-28dc1f935335'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.798905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d7263467d84d58abcfa86e3925067a', 'request_id': 'req-a5cc2e68-ab54-42e3-be49-28dc1f935335'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.809527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] The token cache is being invalidate because project 94d7263467d84d58abcfa86e3925067a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:17:15.809809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.810451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a5cc2e68-ab54-42e3-be49-28dc1f935335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:15.812013 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1311/2632] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:17:15 2022] DELETE /identity/v3/projects/94d7263467d84d58abcfa86e3925067a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:15.817039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66411438-7523-4ca8-966b-6887a75fc101 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:15.817357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66411438-7523-4ca8-966b-6887a75fc101 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:15.817635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66411438-7523-4ca8-966b-6887a75fc101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:15.835506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-66411438-7523-4ca8-966b-6887a75fc101 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:15.836717 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-66411438-7523-4ca8-966b-6887a75fc101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:15.898840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1322/2633] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:15.907453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfff60-6fd7-4e07-854f-7f2ab8220ad3 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:15.907753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfff60-6fd7-4e07-854f-7f2ab8220ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:15.908035 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfff60-6fd7-4e07-854f-7f2ab8220ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:15.926390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-7cbfff60-6fd7-4e07-854f-7f2ab8220ad3 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:15.927664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7cbfff60-6fd7-4e07-854f-7f2ab8220ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:15.935669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1312/2634] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:15.940113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66411438-7523-4ca8-966b-6887a75fc101 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:15.950485 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66411438-7523-4ca8-966b-6887a75fc101 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:15.954989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3127c9-e32e-4931-b3b5-980fb308ec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:15.955635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3127c9-e32e-4931-b3b5-980fb308ec2e admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:15.955920 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3127c9-e32e-4931-b3b5-980fb308ec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:15.956198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3127c9-e32e-4931-b3b5-980fb308ec2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:15.956919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3127c9-e32e-4931-b3b5-980fb308ec2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:17:15.957226 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3127c9-e32e-4931-b3b5-980fb308ec2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:15.958843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3127c9-e32e-4931-b3b5-980fb308ec2e admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:15.970872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1323/2635] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:17:15.975025 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfff60-6fd7-4e07-854f-7f2ab8220ad3 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:15.984478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfff60-6fd7-4e07-854f-7f2ab8220ad3 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:15.989067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d42df-4881-4116-8835-de04b3917084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:15.989710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d42df-4881-4116-8835-de04b3917084 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:15.989993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d42df-4881-4116-8835-de04b3917084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:15.990269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d42df-4881-4116-8835-de04b3917084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:15.991014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d42df-4881-4116-8835-de04b3917084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:15.992896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d42df-4881-4116-8835-de04b3917084 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:16.018325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1313/2636] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:17:15 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:17:16.022429 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3127c9-e32e-4931-b3b5-980fb308ec2e admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:16.033068 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3127c9-e32e-4931-b3b5-980fb308ec2e admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:16.071740 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:16.091339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bcd67-8d89-47bd-941e-3697e8f3ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:16.092007 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bcd67-8d89-47bd-941e-3697e8f3ab78 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:16.092294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bcd67-8d89-47bd-941e-3697e8f3ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:16.092567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bcd67-8d89-47bd-941e-3697e8f3ab78 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:16.093255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bcd67-8d89-47bd-941e-3697e8f3ab78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:16.095200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bcd67-8d89-47bd-941e-3697e8f3ab78 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:16.114199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1324/2637] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:17:16 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:17:16.118242 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d42df-4881-4116-8835-de04b3917084 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:16.128558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d42df-4881-4116-8835-de04b3917084 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:16.133406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7f988-8565-4acc-b841-4751b52217aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:16.134058 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7f988-8565-4acc-b841-4751b52217aa admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:16.134339 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7f988-8565-4acc-b841-4751b52217aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:16.134616 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7f988-8565-4acc-b841-4751b52217aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:16.135966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7f988-8565-4acc-b841-4751b52217aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:16.137557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7f988-8565-4acc-b841-4751b52217aa admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:16.147900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1314/2638] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:17:16.152321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bcd67-8d89-47bd-941e-3697e8f3ab78 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:16.162126 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bcd67-8d89-47bd-941e-3697e8f3ab78 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:16.166794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3224d8-4889-45cf-a978-683906b593ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:16.167448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3224d8-4889-45cf-a978-683906b593ec admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:16.167735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3224d8-4889-45cf-a978-683906b593ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:16.168013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3224d8-4889-45cf-a978-683906b593ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:16.168735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3224d8-4889-45cf-a978-683906b593ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:16.170318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3224d8-4889-45cf-a978-683906b593ec admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:16.180129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1325/2639] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:17:16.184038 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7f988-8565-4acc-b841-4751b52217aa admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:16.194081 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7f988-8565-4acc-b841-4751b52217aa admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:16.199137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ef989-b872-4bef-bf5c-acee1bab2474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:16.200005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef989-b872-4bef-bf5c-acee1bab2474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:16.200294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef989-b872-4bef-bf5c-acee1bab2474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:16.200569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef989-b872-4bef-bf5c-acee1bab2474 admin admin] PATH_INFO: `/v3/projects/71be575e46184904b3178992b692f1b7/users/038f5032fbdb4e80a2864399fccda183/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:16.215710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ef989-b872-4bef-bf5c-acee1bab2474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71be575e46184904b3178992b692f1b7, user_id=038f5032fbdb4e80a2864399fccda183, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:16.218391 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ef989-b872-4bef-bf5c-acee1bab2474 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:16.231066 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1315/2640] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:17:16 2022] PUT /identity/v3/projects/71be575e46184904b3178992b692f1b7/users/038f5032fbdb4e80a2864399fccda183/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:16.236859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea464d1-0021-4841-848d-1e5e1c9cb5e9 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:16.237147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea464d1-0021-4841-848d-1e5e1c9cb5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:16.237423 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea464d1-0021-4841-848d-1e5e1c9cb5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:16.256504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-cea464d1-0021-4841-848d-1e5e1c9cb5e9 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:16.257707 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cea464d1-0021-4841-848d-1e5e1c9cb5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:16.319337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1326/2641] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:16.329467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ef989-b872-4bef-bf5c-acee1bab2474 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:16.331246 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8e1ef989-b872-4bef-bf5c-acee1bab2474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:16.390855 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ef989-b872-4bef-bf5c-acee1bab2474 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:16.396349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ee5ae-800b-4d38-a79a-83e89ed64034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:16.397002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ee5ae-800b-4d38-a79a-83e89ed64034 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:16.397283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ee5ae-800b-4d38-a79a-83e89ed64034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:16.397557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ee5ae-800b-4d38-a79a-83e89ed64034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:16.407381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ee5ae-800b-4d38-a79a-83e89ed64034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:16.408820 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ee5ae-800b-4d38-a79a-83e89ed64034 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:16.419139 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1316/2642] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:17:17.101132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e802e8-7448-45ea-a37b-f53f9d85c247 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:17.101402 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e802e8-7448-45ea-a37b-f53f9d85c247 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:17.101680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e802e8-7448-45ea-a37b-f53f9d85c247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:17.130240 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-04e802e8-7448-45ea-a37b-f53f9d85c247 None None] MFA Rules not processed for user `038f5032fbdb4e80a2864399fccda183`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:17.131500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-04e802e8-7448-45ea-a37b-f53f9d85c247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:17.217108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1327/2643] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:17.221601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ee5ae-800b-4d38-a79a-83e89ed64034 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:17.231268 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ee5ae-800b-4d38-a79a-83e89ed64034 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:17.235899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8442bff-69ce-4358-9285-4febea3632db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:17.236546 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8442bff-69ce-4358-9285-4febea3632db admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:17.236826 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8442bff-69ce-4358-9285-4febea3632db admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:17.237099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8442bff-69ce-4358-9285-4febea3632db admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:17.237807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8442bff-69ce-4358-9285-4febea3632db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:17.239762 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8442bff-69ce-4358-9285-4febea3632db admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:17.265661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1317/2644] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:17:17 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:17:17.269674 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e802e8-7448-45ea-a37b-f53f9d85c247 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:17.280352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e802e8-7448-45ea-a37b-f53f9d85c247 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:17.328467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:17.340114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275263c-47a0-49f5-9d95-a7a8cfe8e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:17.340717 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275263c-47a0-49f5-9d95-a7a8cfe8e74d admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:17.340996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275263c-47a0-49f5-9d95-a7a8cfe8e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:17.341269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275263c-47a0-49f5-9d95-a7a8cfe8e74d admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:17.342038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275263c-47a0-49f5-9d95-a7a8cfe8e74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:17.343998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275263c-47a0-49f5-9d95-a7a8cfe8e74d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:17.363941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1328/2645] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:17:17 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:17:17.367731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8442bff-69ce-4358-9285-4febea3632db admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:17.378087 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8442bff-69ce-4358-9285-4febea3632db admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:17.383281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661098d0-9b31-42b4-81ea-065c2a1336c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:17.383958 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661098d0-9b31-42b4-81ea-065c2a1336c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:17.384239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661098d0-9b31-42b4-81ea-065c2a1336c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:17.384510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661098d0-9b31-42b4-81ea-065c2a1336c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:17.386044 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661098d0-9b31-42b4-81ea-065c2a1336c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:17.387755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661098d0-9b31-42b4-81ea-065c2a1336c2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:17.398330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1318/2646] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:17:17.403074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275263c-47a0-49f5-9d95-a7a8cfe8e74d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:17.413963 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275263c-47a0-49f5-9d95-a7a8cfe8e74d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:17.419166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd637293-276e-4b1c-9bb8-c79a25323fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:17.420054 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd637293-276e-4b1c-9bb8-c79a25323fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:17.420364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd637293-276e-4b1c-9bb8-c79a25323fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:17.420607 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd637293-276e-4b1c-9bb8-c79a25323fee admin admin] PATH_INFO: `/v3/projects/915d0c0db38844bb993b51e80d073ad9/users/1fd50a9c993b4e29bbc3844f38ed4824/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:17.436056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd637293-276e-4b1c-9bb8-c79a25323fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=915d0c0db38844bb993b51e80d073ad9, user_id=1fd50a9c993b4e29bbc3844f38ed4824, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:17.438739 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd637293-276e-4b1c-9bb8-c79a25323fee admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:17.452021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1329/2647] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:17:17 2022] PUT /identity/v3/projects/915d0c0db38844bb993b51e80d073ad9/users/1fd50a9c993b4e29bbc3844f38ed4824/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:17.455964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661098d0-9b31-42b4-81ea-065c2a1336c2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:17.467026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661098d0-9b31-42b4-81ea-065c2a1336c2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:17.493868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:17.541714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47ff26-a0e7-4b77-98a7-dfb0f7b1af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:17.542093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47ff26-a0e7-4b77-98a7-dfb0f7b1af4c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:17.542493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47ff26-a0e7-4b77-98a7-dfb0f7b1af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:17.542739 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47ff26-a0e7-4b77-98a7-dfb0f7b1af4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:17.543474 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47ff26-a0e7-4b77-98a7-dfb0f7b1af4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:17.545227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47ff26-a0e7-4b77-98a7-dfb0f7b1af4c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:17.556571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1319/2648] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:17:17.560368 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd637293-276e-4b1c-9bb8-c79a25323fee admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:17.573500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd637293-276e-4b1c-9bb8-c79a25323fee admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:17.580479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be902ab9-c517-42ee-acf2-90514f12c350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:17.581835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be902ab9-c517-42ee-acf2-90514f12c350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:17.581835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be902ab9-c517-42ee-acf2-90514f12c350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:17.582107 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be902ab9-c517-42ee-acf2-90514f12c350 admin admin] PATH_INFO: `/v3/projects/915d0c0db38844bb993b51e80d073ad9/users/1fd50a9c993b4e29bbc3844f38ed4824/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:17.584164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be902ab9-c517-42ee-acf2-90514f12c350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=915d0c0db38844bb993b51e80d073ad9, user_id=1fd50a9c993b4e29bbc3844f38ed4824, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:17.587712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be902ab9-c517-42ee-acf2-90514f12c350 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:17.599259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1330/2649] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:17:17 2022] PUT /identity/v3/projects/915d0c0db38844bb993b51e80d073ad9/users/1fd50a9c993b4e29bbc3844f38ed4824/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:17:18.239167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1992e7-aa5f-4c63-ac44-cce8ba0de713 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:18.239685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1992e7-aa5f-4c63-ac44-cce8ba0de713 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:18.239801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1992e7-aa5f-4c63-ac44-cce8ba0de713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:18.269202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4a1992e7-aa5f-4c63-ac44-cce8ba0de713 None None] MFA Rules not processed for user `1fd50a9c993b4e29bbc3844f38ed4824`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:18.270414 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4a1992e7-aa5f-4c63-ac44-cce8ba0de713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:18.343608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1320/2650] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:18.355656 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be902ab9-c517-42ee-acf2-90514f12c350 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:18.357373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-be902ab9-c517-42ee-acf2-90514f12c350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:18.417520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be902ab9-c517-42ee-acf2-90514f12c350 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:18.421162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62367e2-a29d-4e38-8062-34dc03e6662a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:18.421814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62367e2-a29d-4e38-8062-34dc03e6662a service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:18.422103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62367e2-a29d-4e38-8062-34dc03e6662a service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:18.422383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62367e2-a29d-4e38-8062-34dc03e6662a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:18.478056 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62367e2-a29d-4e38-8062-34dc03e6662a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:18.480114 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62367e2-a29d-4e38-8062-34dc03e6662a service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:18.488960 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1331/2651] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:17:19.842674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1992e7-aa5f-4c63-ac44-cce8ba0de713 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:19.845196 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4a1992e7-aa5f-4c63-ac44-cce8ba0de713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:19.857252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1992e7-aa5f-4c63-ac44-cce8ba0de713 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:19.860747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa8acf-07d5-4ab0-bf64-b0702660a5bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:19.861385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8acf-07d5-4ab0-bf64-b0702660a5bb service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:19.861663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8acf-07d5-4ab0-bf64-b0702660a5bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:19.861934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8acf-07d5-4ab0-bf64-b0702660a5bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:19.871003 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa8acf-07d5-4ab0-bf64-b0702660a5bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:19.872415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa8acf-07d5-4ab0-bf64-b0702660a5bb service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:19.882314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1321/2652] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:17:21.421494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a694-3c29-449f-8e7f-958089614302 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:21.422671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a694-3c29-449f-8e7f-958089614302 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:21.423064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a694-3c29-449f-8e7f-958089614302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:21.441290 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-a597a694-3c29-449f-8e7f-958089614302 None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:21.442620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a597a694-3c29-449f-8e7f-958089614302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:21.498804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1332/2653] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:17:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:21.544638 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa8acf-07d5-4ab0-bf64-b0702660a5bb service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:21.546032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9bfa8acf-07d5-4ab0-bf64-b0702660a5bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:21.614483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa8acf-07d5-4ab0-bf64-b0702660a5bb service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:21.619433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaec8c4-a92d-421d-a52c-d81178019063 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:21.620070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaec8c4-a92d-421d-a52c-d81178019063 service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:21.620353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaec8c4-a92d-421d-a52c-d81178019063 service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:21.620629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaec8c4-a92d-421d-a52c-d81178019063 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:21.628576 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaec8c4-a92d-421d-a52c-d81178019063 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:21.630413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaec8c4-a92d-421d-a52c-d81178019063 service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:21.639097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1322/2654] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:17:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:17:31.492235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:31.635658 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:33.158347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597a694-3c29-449f-8e7f-958089614302 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:33.159990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a597a694-3c29-449f-8e7f-958089614302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:33.226977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaec8c4-a92d-421d-a52c-d81178019063 service swift] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:33.245344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597a694-3c29-449f-8e7f-958089614302 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:33.252713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9649-ad1a-4784-a2fb-bbcf7e12c426 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:33.253414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9649-ad1a-4784-a2fb-bbcf7e12c426 service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:33.253725 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9649-ad1a-4784-a2fb-bbcf7e12c426 service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:33.254380 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9649-ad1a-4784-a2fb-bbcf7e12c426 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:33.256888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e5ec9649-ad1a-4784-a2fb-bbcf7e12c426 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:33.269432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec9649-ad1a-4784-a2fb-bbcf7e12c426 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:33.271047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec9649-ad1a-4784-a2fb-bbcf7e12c426 service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:33.282831 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1333/2655] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:17:33.307840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaec8c4-a92d-421d-a52c-d81178019063 service swift] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:33.312445 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:33.313315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:33.313595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:33.314050 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] PATH_INFO: `/v3/users/038f5032fbdb4e80a2864399fccda183` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:33.315467 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038f5032fbdb4e80a2864399fccda183)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:33.317458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:33.364970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038f5032fbdb4e80a2864399fccda183'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.372577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038f5032fbdb4e80a2864399fccda183'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.373265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038f5032fbdb4e80a2864399fccda183'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.373872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038f5032fbdb4e80a2864399fccda183'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.386112 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038f5032fbdb4e80a2864399fccda183'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.404424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1323/2656] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:17:33 2022] DELETE /identity/v3/users/038f5032fbdb4e80a2864399fccda183 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:17:33.633275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9649-ad1a-4784-a2fb-bbcf7e12c426 service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:33.644627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec9649-ad1a-4784-a2fb-bbcf7e12c426 service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:33.705547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:33.706419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:33.706722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:33.707012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] PATH_INFO: `/v3/projects/71be575e46184904b3178992b692f1b7` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:33.708180 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71be575e46184904b3178992b692f1b7)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:33.710086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:33.757396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71be575e46184904b3178992b692f1b7', 'request_id': 'req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.765697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71be575e46184904b3178992b692f1b7', 'request_id': 'req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.771775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71be575e46184904b3178992b692f1b7', 'request_id': 'req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.784120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] The token cache is being invalidate because project 71be575e46184904b3178992b692f1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:17:33.784412 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.785064 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.786631 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1334/2657] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:17:33 2022] DELETE /identity/v3/projects/71be575e46184904b3178992b692f1b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:33.790577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:33.792809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:33.806177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9ada1-8de7-47fd-bbbd-e638f908c9c9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:33.870599 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:33.871506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:33.871789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:33.872063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] PATH_INFO: `/v3/users/1fd50a9c993b4e29bbc3844f38ed4824` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:33.873269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd50a9c993b4e29bbc3844f38ed4824)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:33.875257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:33.898073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:33.927854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd50a9c993b4e29bbc3844f38ed4824'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.935748 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd50a9c993b4e29bbc3844f38ed4824'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.936422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd50a9c993b4e29bbc3844f38ed4824'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.937020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd50a9c993b4e29bbc3844f38ed4824'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.948683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-28d132bc-d10f-438d-8e3a-d3c5c8bff006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd50a9c993b4e29bbc3844f38ed4824'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:33.961022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1324/2658] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:17:33 2022] DELETE /identity/v3/users/1fd50a9c993b4e29bbc3844f38ed4824 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:34.139678 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:34.141256 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:34.158277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f4ff6-eaa5-4cf3-8bd5-2a157a197bb3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:34.177557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:34.221512 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:34.222407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.222712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.222995 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] PATH_INFO: `/v3/projects/915d0c0db38844bb993b51e80d073ad9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.224179 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915d0c0db38844bb993b51e80d073ad9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:34.226095 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:34.277597 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915d0c0db38844bb993b51e80d073ad9', 'request_id': 'req-7ed6d304-7189-4138-88a9-2a39822a4c21'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:34.285495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915d0c0db38844bb993b51e80d073ad9', 'request_id': 'req-7ed6d304-7189-4138-88a9-2a39822a4c21'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:34.291827 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915d0c0db38844bb993b51e80d073ad9', 'request_id': 'req-7ed6d304-7189-4138-88a9-2a39822a4c21'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:34.303189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] The token cache is being invalidate because project 915d0c0db38844bb993b51e80d073ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:17:34.303496 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:34.304132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-7ed6d304-7189-4138-88a9-2a39822a4c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:17:34.305817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1335/2659] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:17:34 2022] DELETE /identity/v3/projects/915d0c0db38844bb993b51e80d073ad9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:34.310769 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b15ef-5cac-4b46-aa07-2d17e6f6267b None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.311247 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b15ef-5cac-4b46-aa07-2d17e6f6267b None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.311343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b15ef-5cac-4b46-aa07-2d17e6f6267b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.329497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-bd9b15ef-5cac-4b46-aa07-2d17e6f6267b None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:34.330716 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-bd9b15ef-5cac-4b46-aa07-2d17e6f6267b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:34.389374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1325/2660] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:34.398261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b598478-15f1-44d7-8f9b-71ee34401e9c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.398494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b598478-15f1-44d7-8f9b-71ee34401e9c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.398812 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b598478-15f1-44d7-8f9b-71ee34401e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.419441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-1b598478-15f1-44d7-8f9b-71ee34401e9c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:34.420640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1b598478-15f1-44d7-8f9b-71ee34401e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:34.428496 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1336/2661] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:34.432918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b15ef-5cac-4b46-aa07-2d17e6f6267b None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:34.442388 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b15ef-5cac-4b46-aa07-2d17e6f6267b None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:34.446894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e198d2-0ceb-4873-b20c-c440530b9354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:34.447633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e198d2-0ceb-4873-b20c-c440530b9354 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.447914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e198d2-0ceb-4873-b20c-c440530b9354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.448187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e198d2-0ceb-4873-b20c-c440530b9354 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.448905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e198d2-0ceb-4873-b20c-c440530b9354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:17:34.449208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e198d2-0ceb-4873-b20c-c440530b9354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:34.450809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e198d2-0ceb-4873-b20c-c440530b9354 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:34.462226 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1326/2662] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:17:34.467233 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b598478-15f1-44d7-8f9b-71ee34401e9c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:34.476710 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b598478-15f1-44d7-8f9b-71ee34401e9c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:34.482462 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3658ac-9b2f-4c1d-a022-0da530356276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:34.483133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3658ac-9b2f-4c1d-a022-0da530356276 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.483416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3658ac-9b2f-4c1d-a022-0da530356276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.483688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3658ac-9b2f-4c1d-a022-0da530356276 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.484371 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3658ac-9b2f-4c1d-a022-0da530356276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:34.486260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3658ac-9b2f-4c1d-a022-0da530356276 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:34.511031 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1337/2663] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:17:34 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:17:34.515149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e198d2-0ceb-4873-b20c-c440530b9354 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:34.525175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e198d2-0ceb-4873-b20c-c440530b9354 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:34.582512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944def48-3e9d-4949-b179-1deab4a21238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:34.583194 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944def48-3e9d-4949-b179-1deab4a21238 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.583475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944def48-3e9d-4949-b179-1deab4a21238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.583746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944def48-3e9d-4949-b179-1deab4a21238 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.584419 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944def48-3e9d-4949-b179-1deab4a21238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:34.586315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944def48-3e9d-4949-b179-1deab4a21238 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:34.607670 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1327/2664] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:17:34 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:17:34.611837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3658ac-9b2f-4c1d-a022-0da530356276 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:34.622327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3658ac-9b2f-4c1d-a022-0da530356276 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:34.626810 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfcf78-fbaf-4911-b78e-9a8a4c21709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:34.627460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfcf78-fbaf-4911-b78e-9a8a4c21709b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.627742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfcf78-fbaf-4911-b78e-9a8a4c21709b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.628016 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfcf78-fbaf-4911-b78e-9a8a4c21709b admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.628759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfcf78-fbaf-4911-b78e-9a8a4c21709b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:34.630609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfcf78-fbaf-4911-b78e-9a8a4c21709b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:34.641777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1338/2665] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:17:34.645411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944def48-3e9d-4949-b179-1deab4a21238 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:34.655931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944def48-3e9d-4949-b179-1deab4a21238 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:34.660363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131ab69-f19f-49a8-a85c-f739f5786ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:34.661001 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131ab69-f19f-49a8-a85c-f739f5786ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.661280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131ab69-f19f-49a8-a85c-f739f5786ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.661553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131ab69-f19f-49a8-a85c-f739f5786ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.662262 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131ab69-f19f-49a8-a85c-f739f5786ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:34.663867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131ab69-f19f-49a8-a85c-f739f5786ed4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:34.674330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1328/2666] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:17:34.678260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfcf78-fbaf-4911-b78e-9a8a4c21709b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:34.688130 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfcf78-fbaf-4911-b78e-9a8a4c21709b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:34.692967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38762594-c381-4e7c-a1c0-32c8452df3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:34.693868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38762594-c381-4e7c-a1c0-32c8452df3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.694152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38762594-c381-4e7c-a1c0-32c8452df3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.694424 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38762594-c381-4e7c-a1c0-32c8452df3d4 admin admin] PATH_INFO: `/v3/projects/0a788590a90b4843bb01736f94feede1/users/f0ae850cc7cd49d487576d3d848086c9/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.709756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38762594-c381-4e7c-a1c0-32c8452df3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a788590a90b4843bb01736f94feede1, user_id=f0ae850cc7cd49d487576d3d848086c9, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:34.712452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38762594-c381-4e7c-a1c0-32c8452df3d4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:34.725154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1339/2667] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:17:34 2022] PUT /identity/v3/projects/0a788590a90b4843bb01736f94feede1/users/f0ae850cc7cd49d487576d3d848086c9/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:17:34.735817 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d398-0652-4fe7-b6b8-22ee92d6f4e0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.736109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d398-0652-4fe7-b6b8-22ee92d6f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.736387 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d398-0652-4fe7-b6b8-22ee92d6f4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.742959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:34.764349 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-6000d398-0652-4fe7-b6b8-22ee92d6f4e0 None None] MFA Rules not processed for user `f0ae850cc7cd49d487576d3d848086c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:34.765549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6000d398-0652-4fe7-b6b8-22ee92d6f4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:34.828363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1329/2668] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:34.839866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38762594-c381-4e7c-a1c0-32c8452df3d4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:34.841545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-38762594-c381-4e7c-a1c0-32c8452df3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:34.893721 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:34.899847 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38762594-c381-4e7c-a1c0-32c8452df3d4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:34.904448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e4000-3a06-4d43-b86f-4c816ecb0422 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a5d7aee47e43e9904a93c6ce3bb412', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:34.905139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e4000-3a06-4d43-b86f-4c816ecb0422 service glance] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:34.905448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e4000-3a06-4d43-b86f-4c816ecb0422 service glance] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:34.905726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e4000-3a06-4d43-b86f-4c816ecb0422 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:34.914131 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e4000-3a06-4d43-b86f-4c816ecb0422 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:34.915604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e4000-3a06-4d43-b86f-4c816ecb0422 service glance] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:34.925191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1340/2669] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:17:39.311781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89487657-8e14-42c4-b7d5-ceb40e3a0104 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:39.312267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89487657-8e14-42c4-b7d5-ceb40e3a0104 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:39.312457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89487657-8e14-42c4-b7d5-ceb40e3a0104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:39.331666 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-89487657-8e14-42c4-b7d5-ceb40e3a0104 None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:17:39.333091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-89487657-8e14-42c4-b7d5-ceb40e3a0104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:39.391101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1330/2670] 10.222.0.30 () {58 vars in 1009 bytes} [Mon May 23 18:17:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:17:39.404540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e4000-3a06-4d43-b86f-4c816ecb0422 service glance] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:39.406019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-da8e4000-3a06-4d43-b86f-4c816ecb0422 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:39.477622 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e4000-3a06-4d43-b86f-4c816ecb0422 service glance] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:39.483954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd2bba-83a3-4945-89e3-855541126c6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:39.484591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd2bba-83a3-4945-89e3-855541126c6b service swift] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:39.484871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd2bba-83a3-4945-89e3-855541126c6b service swift] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:39.485145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd2bba-83a3-4945-89e3-855541126c6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:39.493043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd2bba-83a3-4945-89e3-855541126c6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:39.495563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd2bba-83a3-4945-89e3-855541126c6b service swift] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:39.504914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1341/2671] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:17:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:17:43.588148 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89487657-8e14-42c4-b7d5-ceb40e3a0104 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:43.589795 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-89487657-8e14-42c4-b7d5-ceb40e3a0104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:43.650633 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89487657-8e14-42c4-b7d5-ceb40e3a0104 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:43.655049 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e88053-e050-47c1-be43-8b6fdd07ee66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:43.655710 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e88053-e050-47c1-be43-8b6fdd07ee66 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:43.655997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e88053-e050-47c1-be43-8b6fdd07ee66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:43.656277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e88053-e050-47c1-be43-8b6fdd07ee66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:43.658088 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-85e88053-e050-47c1-be43-8b6fdd07ee66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:43.720907 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:43.745849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e88053-e050-47c1-be43-8b6fdd07ee66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:43.747483 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e88053-e050-47c1-be43-8b6fdd07ee66 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:43.768622 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1331/2672] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:17:44.970296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd2bba-83a3-4945-89e3-855541126c6b service swift] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:44.972014 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2fcd2bba-83a3-4945-89e3-855541126c6b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:44.985623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd2bba-83a3-4945-89e3-855541126c6b service swift] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:44.989483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c1e69-f48e-42ac-965f-87b3935e4351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:44.990128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c1e69-f48e-42ac-965f-87b3935e4351 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:44.990508 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c1e69-f48e-42ac-965f-87b3935e4351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:44.990811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c1e69-f48e-42ac-965f-87b3935e4351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:44.992789 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fd7c1e69-f48e-42ac-965f-87b3935e4351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:45.012700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c1e69-f48e-42ac-965f-87b3935e4351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:45.014681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c1e69-f48e-42ac-965f-87b3935e4351 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:45.034074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1342/2673] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:17:53.755876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=9 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:55.023263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=43 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:17:57.917892 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e88053-e050-47c1-be43-8b6fdd07ee66 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:17:57.919311 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-85e88053-e050-47c1-be43-8b6fdd07ee66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:57.932986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e88053-e050-47c1-be43-8b6fdd07ee66 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:17:57.938358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87e24b-45fa-408e-b5df-284062b52f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:17:57.939027 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87e24b-45fa-408e-b5df-284062b52f9c service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:17:57.939314 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87e24b-45fa-408e-b5df-284062b52f9c service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:17:57.939592 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87e24b-45fa-408e-b5df-284062b52f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:17:57.941458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ca87e24b-45fa-408e-b5df-284062b52f9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:17:58.022276 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87e24b-45fa-408e-b5df-284062b52f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:17:58.024095 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87e24b-45fa-408e-b5df-284062b52f9c service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:17:58.052301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1332/2674] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:17:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:18:08.049444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=41 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:08.875780 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b730cfb-2252-46b1-93be-7ad902be6562 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:08.876214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b730cfb-2252-46b1-93be-7ad902be6562 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:08.876344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b730cfb-2252-46b1-93be-7ad902be6562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:08.893933 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7b730cfb-2252-46b1-93be-7ad902be6562 None None] MFA Rules not processed for user `3170dcaf527b44b8bd33cae78b39fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:18:08.895219 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7b730cfb-2252-46b1-93be-7ad902be6562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:08.903951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1343/2675] 10.222.0.30 () {58 vars in 967 bytes} [Mon May 23 18:18:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:18:08.916271 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87e24b-45fa-408e-b5df-284062b52f9c service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:08.928320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87e24b-45fa-408e-b5df-284062b52f9c service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:08.933528 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9f70d-25d4-43a5-85b9-530b7beeb95f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbd7035e027494cb063489b375cb385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:08.934167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f70d-25d4-43a5-85b9-530b7beeb95f service swift] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:08.934458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f70d-25d4-43a5-85b9-530b7beeb95f service swift] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:08.934768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f70d-25d4-43a5-85b9-530b7beeb95f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:08.943545 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9f70d-25d4-43a5-85b9-530b7beeb95f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:08.945340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9f70d-25d4-43a5-85b9-530b7beeb95f service swift] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:08.953814 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1333/2676] 10.222.0.30 () {60 vars in 1384 bytes} [Mon May 23 18:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 18:18:12.067253 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b730cfb-2252-46b1-93be-7ad902be6562 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:12.129383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b730cfb-2252-46b1-93be-7ad902be6562 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:12.134200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:12.135096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:12.135410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:12.136324 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] PATH_INFO: `/v3/users/f0ae850cc7cd49d487576d3d848086c9` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:12.137572 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ae850cc7cd49d487576d3d848086c9)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:12.139529 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:12.185350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ae850cc7cd49d487576d3d848086c9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:12.185986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ae850cc7cd49d487576d3d848086c9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:12.192968 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ae850cc7cd49d487576d3d848086c9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:12.193606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ae850cc7cd49d487576d3d848086c9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:12.206032 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ae850cc7cd49d487576d3d848086c9'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:12.219883 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1344/2677] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:18:12 2022] DELETE /identity/v3/users/f0ae850cc7cd49d487576d3d848086c9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:18:12.224385 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258b73c-328b-443e-86c8-3ced0823291d None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:12.224889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258b73c-328b-443e-86c8-3ced0823291d None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:12.224987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258b73c-328b-443e-86c8-3ced0823291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:12.241898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c258b73c-328b-443e-86c8-3ced0823291d None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:18:12.243310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c258b73c-328b-443e-86c8-3ced0823291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:12.301683 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1334/2678] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:18:12.311084 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:12.312482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:12.370660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8374-32b0-4c7d-8be2-2677869613e4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:12.374344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedda4d3-d7d3-4e2d-8113-d48cb5ab9c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:12.374997 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedda4d3-d7d3-4e2d-8113-d48cb5ab9c49 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:12.375282 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedda4d3-d7d3-4e2d-8113-d48cb5ab9c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:12.375559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedda4d3-d7d3-4e2d-8113-d48cb5ab9c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:12.384704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedda4d3-d7d3-4e2d-8113-d48cb5ab9c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:12.386690 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedda4d3-d7d3-4e2d-8113-d48cb5ab9c49 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:12.396203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1345/2679] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:18:12.665641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258b73c-328b-443e-86c8-3ced0823291d None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:12.667781 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c258b73c-328b-443e-86c8-3ced0823291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:12.681455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258b73c-328b-443e-86c8-3ced0823291d None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:12.685973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:12.687377 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:12.687829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:12.688113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] PATH_INFO: `/v3/projects/0a788590a90b4843bb01736f94feede1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:12.689288 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a788590a90b4843bb01736f94feede1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:12.691257 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:12.738178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a788590a90b4843bb01736f94feede1', 'request_id': 'req-5396e74b-a39c-43d8-a45f-bd9caaf3149b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:12.745838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a788590a90b4843bb01736f94feede1', 'request_id': 'req-5396e74b-a39c-43d8-a45f-bd9caaf3149b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:12.751974 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a788590a90b4843bb01736f94feede1', 'request_id': 'req-5396e74b-a39c-43d8-a45f-bd9caaf3149b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:12.763327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] The token cache is being invalidate because project 0a788590a90b4843bb01736f94feede1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:18:12.763611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:12.764235 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:12.765747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1335/2680] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:18:12 2022] DELETE /identity/v3/projects/0a788590a90b4843bb01736f94feede1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:18:22.391981 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:22.759368 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:34.331309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8767891-d91e-47c4-80be-7f02031d7a43 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:34.331857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8767891-d91e-47c4-80be-7f02031d7a43 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:34.331857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8767891-d91e-47c4-80be-7f02031d7a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:34.349925 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-f8767891-d91e-47c4-80be-7f02031d7a43 None None] MFA Rules not processed for user `06b8d18d37e7467f84841ec6ac0080fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:18:34.351165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f8767891-d91e-47c4-80be-7f02031d7a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:34.413348 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1346/2681] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:18:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:18:37.108427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:37.109794 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:37.172714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396e74b-a39c-43d8-a45f-bd9caaf3149b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:37.176294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a70a15-dd56-4aaf-9649-d72a4a411ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:37.176946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a70a15-dd56-4aaf-9649-d72a4a411ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:37.177228 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a70a15-dd56-4aaf-9649-d72a4a411ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:37.177505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a70a15-dd56-4aaf-9649-d72a4a411ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:37.179390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c0a70a15-dd56-4aaf-9649-d72a4a411ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:37.191905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a70a15-dd56-4aaf-9649-d72a4a411ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:37.193353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a70a15-dd56-4aaf-9649-d72a4a411ca8 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:37.201879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1336/2682] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:18:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:18:44.400785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=25 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:47.198729 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=26 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:52.797928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8767891-d91e-47c4-80be-7f02031d7a43 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:52.799879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f8767891-d91e-47c4-80be-7f02031d7a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:52.887242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8767891-d91e-47c4-80be-7f02031d7a43 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:52.893594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1a5f-c729-4c6e-89fc-e3b2c686ecc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:52.894182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1a5f-c729-4c6e-89fc-e3b2c686ecc5 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:52.894464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1a5f-c729-4c6e-89fc-e3b2c686ecc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:52.894762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1a5f-c729-4c6e-89fc-e3b2c686ecc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:52.896589 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-44ef1a5f-c729-4c6e-89fc-e3b2c686ecc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:52.908856 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef1a5f-c729-4c6e-89fc-e3b2c686ecc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:52.910479 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef1a5f-c729-4c6e-89fc-e3b2c686ecc5 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:52.921897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1347/2683] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:18:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:18:55.480199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a70a15-dd56-4aaf-9649-d72a4a411ca8 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:55.481596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c0a70a15-dd56-4aaf-9649-d72a4a411ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:55.494986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a70a15-dd56-4aaf-9649-d72a4a411ca8 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:55.499607 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eb36c-7797-41b9-a4ec-f033c4853b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:55.500322 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb36c-7797-41b9-a4ec-f033c4853b0c service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:55.500681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb36c-7797-41b9-a4ec-f033c4853b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:55.501024 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb36c-7797-41b9-a4ec-f033c4853b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:55.502888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ad7eb36c-7797-41b9-a4ec-f033c4853b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:55.530969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1a5f-c729-4c6e-89fc-e3b2c686ecc5 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:55.541639 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1a5f-c729-4c6e-89fc-e3b2c686ecc5 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:55.545941 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfea00-924c-41c4-9615-fedea35779dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:55.546588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfea00-924c-41c4-9615-fedea35779dc service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:55.546985 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfea00-924c-41c4-9615-fedea35779dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:55.547376 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfea00-924c-41c4-9615-fedea35779dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:55.549263 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0ddfea00-924c-41c4-9615-fedea35779dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:55.577806 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7eb36c-7797-41b9-a4ec-f033c4853b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:55.579378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7eb36c-7797-41b9-a4ec-f033c4853b0c service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:55.589342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1337/2684] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:18:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:18:55.614154 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfea00-924c-41c4-9615-fedea35779dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:55.615643 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfea00-924c-41c4-9615-fedea35779dc service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:55.625522 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1348/2685] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:18:59.314117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eb36c-7797-41b9-a4ec-f033c4853b0c service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:59.315909 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ad7eb36c-7797-41b9-a4ec-f033c4853b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:59.333207 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eb36c-7797-41b9-a4ec-f033c4853b0c service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:59.337859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:59.338853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:59.339137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:59.339411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] PATH_INFO: `/v3/users/8d08ba344a9349d99de16520d3ce5150` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:59.356171 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d08ba344a9349d99de16520d3ce5150)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:59.358343 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:59.413436 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d08ba344a9349d99de16520d3ce5150'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:59.421849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d08ba344a9349d99de16520d3ce5150'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:59.422618 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d08ba344a9349d99de16520d3ce5150'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:59.423284 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d08ba344a9349d99de16520d3ce5150'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:59.437451 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9850787f-7f33-49a5-8ffe-744afa3a68ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d08ba344a9349d99de16520d3ce5150'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:59.455707 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1338/2686] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:18:59 2022] DELETE /identity/v3/users/8d08ba344a9349d99de16520d3ce5150 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:18:59.641204 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfea00-924c-41c4-9615-fedea35779dc service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:59.651783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfea00-924c-41c4-9615-fedea35779dc service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:59.717297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:59.718162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:59.718447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:59.718756 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] PATH_INFO: `/v3/projects/e00ef21138204550843697c5f33a8999` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:59.728938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00ef21138204550843697c5f33a8999)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:59.730886 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:59.742605 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=100 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:59.776021 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00ef21138204550843697c5f33a8999', 'request_id': 'req-8df0c914-117c-40e9-abe7-e150192c9341'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:59.784222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00ef21138204550843697c5f33a8999', 'request_id': 'req-8df0c914-117c-40e9-abe7-e150192c9341'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:59.790301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00ef21138204550843697c5f33a8999', 'request_id': 'req-8df0c914-117c-40e9-abe7-e150192c9341'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:59.802307 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] The token cache is being invalidate because project e00ef21138204550843697c5f33a8999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:18:59.802595 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:59.803247 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-8df0c914-117c-40e9-abe7-e150192c9341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:18:59.804759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1349/2687] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:18:59 2022] DELETE /identity/v3/projects/e00ef21138204550843697c5f33a8999 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:18:59.809690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8526f2-e70b-4629-9114-6d891caa77f5 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:59.809927 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8526f2-e70b-4629-9114-6d891caa77f5 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:59.810206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8526f2-e70b-4629-9114-6d891caa77f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:59.828562 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-4b8526f2-e70b-4629-9114-6d891caa77f5 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:18:59.829746 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4b8526f2-e70b-4629-9114-6d891caa77f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:59.877898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:18:59.890931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1339/2688] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:18:59.898352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487c16a-5690-4214-a0f6-23d4fd1904ff None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:59.898648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487c16a-5690-4214-a0f6-23d4fd1904ff None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:59.898972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487c16a-5690-4214-a0f6-23d4fd1904ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:59.916239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5487c16a-5690-4214-a0f6-23d4fd1904ff None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:18:59.917474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5487c16a-5690-4214-a0f6-23d4fd1904ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:18:59.925917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1350/2689] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:18:59.929918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8526f2-e70b-4629-9114-6d891caa77f5 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:59.940233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8526f2-e70b-4629-9114-6d891caa77f5 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:59.944718 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a0ebe-63ff-4510-a60a-cc3c55c2316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:59.945360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a0ebe-63ff-4510-a60a-cc3c55c2316c admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:59.945642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a0ebe-63ff-4510-a60a-cc3c55c2316c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:59.945919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a0ebe-63ff-4510-a60a-cc3c55c2316c admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:59.946635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a0ebe-63ff-4510-a60a-cc3c55c2316c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:18:59.946973 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a0ebe-63ff-4510-a60a-cc3c55c2316c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:59.948557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a0ebe-63ff-4510-a60a-cc3c55c2316c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:18:59.959915 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1340/2690] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 18:18:59.964005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487c16a-5690-4214-a0f6-23d4fd1904ff None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:18:59.973298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487c16a-5690-4214-a0f6-23d4fd1904ff None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:18:59.977952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb83c6-bba7-4586-bed9-cb1ba505ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:18:59.978593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb83c6-bba7-4586-bed9-cb1ba505ecce admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:18:59.978908 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb83c6-bba7-4586-bed9-cb1ba505ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:18:59.979186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb83c6-bba7-4586-bed9-cb1ba505ecce admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:18:59.979869 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb83c6-bba7-4586-bed9-cb1ba505ecce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:18:59.981781 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb83c6-bba7-4586-bed9-cb1ba505ecce admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:00.008904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1351/2691] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:18:59 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:19:00.012898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a0ebe-63ff-4510-a60a-cc3c55c2316c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:00.022660 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a0ebe-63ff-4510-a60a-cc3c55c2316c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:00.078328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909cc2f-9398-47a5-a139-8b32fb6778e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:00.078959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909cc2f-9398-47a5-a139-8b32fb6778e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:00.079244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909cc2f-9398-47a5-a139-8b32fb6778e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:00.079522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909cc2f-9398-47a5-a139-8b32fb6778e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:00.080202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909cc2f-9398-47a5-a139-8b32fb6778e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:00.082107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909cc2f-9398-47a5-a139-8b32fb6778e0 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:00.102964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1341/2692] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:19:00 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:19:00.106950 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb83c6-bba7-4586-bed9-cb1ba505ecce admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:00.117632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb83c6-bba7-4586-bed9-cb1ba505ecce admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:00.122160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12c8d3-331e-4bac-b9a3-c62073cfd4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:00.122841 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12c8d3-331e-4bac-b9a3-c62073cfd4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:00.123162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12c8d3-331e-4bac-b9a3-c62073cfd4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:00.123434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12c8d3-331e-4bac-b9a3-c62073cfd4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:00.124150 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12c8d3-331e-4bac-b9a3-c62073cfd4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:00.125730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12c8d3-331e-4bac-b9a3-c62073cfd4fb admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:00.135842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1352/2693] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:00.140109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909cc2f-9398-47a5-a139-8b32fb6778e0 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:00.150170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909cc2f-9398-47a5-a139-8b32fb6778e0 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:00.155432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815988b3-65f7-4483-9143-d0af32ad8695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:00.156136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815988b3-65f7-4483-9143-d0af32ad8695 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:00.156422 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815988b3-65f7-4483-9143-d0af32ad8695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:00.156703 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815988b3-65f7-4483-9143-d0af32ad8695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:00.157428 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815988b3-65f7-4483-9143-d0af32ad8695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:00.159070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815988b3-65f7-4483-9143-d0af32ad8695 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:00.169316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1342/2694] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:00.173942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12c8d3-331e-4bac-b9a3-c62073cfd4fb admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:00.183988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12c8d3-331e-4bac-b9a3-c62073cfd4fb admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:00.188949 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6af0-97fb-47f0-8cdc-b76c6e9aa60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:00.190692 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6af0-97fb-47f0-8cdc-b76c6e9aa60d admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:00.192067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6af0-97fb-47f0-8cdc-b76c6e9aa60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:00.192067 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6af0-97fb-47f0-8cdc-b76c6e9aa60d admin admin] PATH_INFO: `/v3/projects/bc06252b05d142e3b293c2c3fa0ed12f/users/130fd035a1a442fc8ec1f5cc6716c038/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:00.208161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed6af0-97fb-47f0-8cdc-b76c6e9aa60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc06252b05d142e3b293c2c3fa0ed12f, user_id=130fd035a1a442fc8ec1f5cc6716c038, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:00.210877 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed6af0-97fb-47f0-8cdc-b76c6e9aa60d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:00.224041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1353/2695] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:19:00 2022] PUT /identity/v3/projects/bc06252b05d142e3b293c2c3fa0ed12f/users/130fd035a1a442fc8ec1f5cc6716c038/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:00.236583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7cafa-7d4c-4832-9213-dff2a3a72c19 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:00.237085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7cafa-7d4c-4832-9213-dff2a3a72c19 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:00.237573 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7cafa-7d4c-4832-9213-dff2a3a72c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:00.265204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-96e7cafa-7d4c-4832-9213-dff2a3a72c19 None None] MFA Rules not processed for user `130fd035a1a442fc8ec1f5cc6716c038`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:00.266397 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-96e7cafa-7d4c-4832-9213-dff2a3a72c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:00.336897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1343/2696] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:00.347951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6af0-97fb-47f0-8cdc-b76c6e9aa60d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:00.349619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-39ed6af0-97fb-47f0-8cdc-b76c6e9aa60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:00.406381 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6af0-97fb-47f0-8cdc-b76c6e9aa60d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:00.410037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce27f3e-141f-4edf-aecd-0dc1f178c440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:00.410680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce27f3e-141f-4edf-aecd-0dc1f178c440 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:00.410996 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce27f3e-141f-4edf-aecd-0dc1f178c440 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:00.411277 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce27f3e-141f-4edf-aecd-0dc1f178c440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:00.420184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce27f3e-141f-4edf-aecd-0dc1f178c440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:00.421637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce27f3e-141f-4edf-aecd-0dc1f178c440 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:00.430614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1354/2697] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:19:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:19:08.709174 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7cafa-7d4c-4832-9213-dff2a3a72c19 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:08.760375 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:08.773699 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7cafa-7d4c-4832-9213-dff2a3a72c19 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:08.778191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:08.779077 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:08.779453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:08.779453 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] PATH_INFO: `/v3/users/130fd035a1a442fc8ec1f5cc6716c038` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:08.780831 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130fd035a1a442fc8ec1f5cc6716c038)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:08.782765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:08.828641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130fd035a1a442fc8ec1f5cc6716c038'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:08.835433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130fd035a1a442fc8ec1f5cc6716c038'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:08.836071 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130fd035a1a442fc8ec1f5cc6716c038'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:08.836674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130fd035a1a442fc8ec1f5cc6716c038'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:08.848620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130fd035a1a442fc8ec1f5cc6716c038'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:08.861895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1344/2698] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:19:08 2022] DELETE /identity/v3/users/130fd035a1a442fc8ec1f5cc6716c038 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:08.866654 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e187613-9937-444f-9e23-fc0fb62e7070 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:08.867183 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e187613-9937-444f-9e23-fc0fb62e7070 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:08.867303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e187613-9937-444f-9e23-fc0fb62e7070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:08.885208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8e187613-9937-444f-9e23-fc0fb62e7070 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:08.886396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8e187613-9937-444f-9e23-fc0fb62e7070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:08.920322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:08.948100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1355/2699] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:08.957793 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:08.959217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:09.017186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba41fe-3fd2-43c7-823c-f8c1f7d9ee20 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:09.020836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598efa4-5ae4-42ca-b934-1c0e745d52a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:09.021475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598efa4-5ae4-42ca-b934-1c0e745d52a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.021763 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598efa4-5ae4-42ca-b934-1c0e745d52a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.022036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598efa4-5ae4-42ca-b934-1c0e745d52a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.031681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598efa4-5ae4-42ca-b934-1c0e745d52a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:09.033175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598efa4-5ae4-42ca-b934-1c0e745d52a3 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:09.042758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1345/2700] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:19:09.315966 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e187613-9937-444f-9e23-fc0fb62e7070 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:09.317550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8e187613-9937-444f-9e23-fc0fb62e7070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:09.330614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e187613-9937-444f-9e23-fc0fb62e7070 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:09.335109 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:09.335972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.336656 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.336656 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] PATH_INFO: `/v3/projects/bc06252b05d142e3b293c2c3fa0ed12f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.337697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc06252b05d142e3b293c2c3fa0ed12f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:09.339627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:09.389564 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc06252b05d142e3b293c2c3fa0ed12f', 'request_id': 'req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:09.396644 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc06252b05d142e3b293c2c3fa0ed12f', 'request_id': 'req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:09.402681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc06252b05d142e3b293c2c3fa0ed12f', 'request_id': 'req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:09.414854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] The token cache is being invalidate because project bc06252b05d142e3b293c2c3fa0ed12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:19:09.415145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:09.415775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d98cfb17-f529-46f3-9fa6-ab8e4f3ab2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:09.417311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1356/2701] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:19:09 2022] DELETE /identity/v3/projects/bc06252b05d142e3b293c2c3fa0ed12f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:09.422438 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbeffc-0153-4ed9-999c-c386b048dda1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.422770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbeffc-0153-4ed9-999c-c386b048dda1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.423052 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbeffc-0153-4ed9-999c-c386b048dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.441424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9bbbeffc-0153-4ed9-999c-c386b048dda1 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:09.443323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9bbbeffc-0153-4ed9-999c-c386b048dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:09.504690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1346/2702] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:09.512823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba1c8-62bd-4ca8-9166-34b5b8d787d2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.513185 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba1c8-62bd-4ca8-9166-34b5b8d787d2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.513468 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba1c8-62bd-4ca8-9166-34b5b8d787d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.532824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-30cba1c8-62bd-4ca8-9166-34b5b8d787d2 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:09.534015 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-30cba1c8-62bd-4ca8-9166-34b5b8d787d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:09.541895 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1357/2703] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:09.546524 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbeffc-0153-4ed9-999c-c386b048dda1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:09.556202 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbeffc-0153-4ed9-999c-c386b048dda1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:09.560785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5954cb6-6dee-43b5-a9d6-24db8ac06e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:09.561502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5954cb6-6dee-43b5-a9d6-24db8ac06e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.561791 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5954cb6-6dee-43b5-a9d6-24db8ac06e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.562070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5954cb6-6dee-43b5-a9d6-24db8ac06e08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.562828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5954cb6-6dee-43b5-a9d6-24db8ac06e08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:19:09.563142 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5954cb6-6dee-43b5-a9d6-24db8ac06e08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:09.564725 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5954cb6-6dee-43b5-a9d6-24db8ac06e08 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:09.573224 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:09.577530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1347/2704] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:19:09.581524 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cba1c8-62bd-4ca8-9166-34b5b8d787d2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:09.590576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cba1c8-62bd-4ca8-9166-34b5b8d787d2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:09.596285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75ebe5-1f7d-472b-8afb-ab958fbe2406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:09.596938 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75ebe5-1f7d-472b-8afb-ab958fbe2406 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.597227 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75ebe5-1f7d-472b-8afb-ab958fbe2406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.597504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75ebe5-1f7d-472b-8afb-ab958fbe2406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.598217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75ebe5-1f7d-472b-8afb-ab958fbe2406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:09.600149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75ebe5-1f7d-472b-8afb-ab958fbe2406 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:09.625238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1358/2705] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:19:09 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:19:09.629325 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5954cb6-6dee-43b5-a9d6-24db8ac06e08 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:09.640170 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5954cb6-6dee-43b5-a9d6-24db8ac06e08 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:09.697421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e101f8-df87-4b6b-94d5-3ca2047eeddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:09.698084 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e101f8-df87-4b6b-94d5-3ca2047eeddf admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.698407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e101f8-df87-4b6b-94d5-3ca2047eeddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.698730 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e101f8-df87-4b6b-94d5-3ca2047eeddf admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.699570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e101f8-df87-4b6b-94d5-3ca2047eeddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:09.701652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e101f8-df87-4b6b-94d5-3ca2047eeddf admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:09.721457 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1348/2706] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:19:09 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:19:09.725503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75ebe5-1f7d-472b-8afb-ab958fbe2406 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:09.736288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75ebe5-1f7d-472b-8afb-ab958fbe2406 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:09.740910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672670f-6a72-4d3f-a38a-04d26f8291de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:09.741563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672670f-6a72-4d3f-a38a-04d26f8291de admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.741850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672670f-6a72-4d3f-a38a-04d26f8291de admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.742129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672670f-6a72-4d3f-a38a-04d26f8291de admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.742890 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672670f-6a72-4d3f-a38a-04d26f8291de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:09.744494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672670f-6a72-4d3f-a38a-04d26f8291de admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:09.755689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1359/2707] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:09.759617 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e101f8-df87-4b6b-94d5-3ca2047eeddf admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:09.769643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e101f8-df87-4b6b-94d5-3ca2047eeddf admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:09.774140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188da69-8405-4acf-b246-d60842f0d7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:09.774823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188da69-8405-4acf-b246-d60842f0d7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.775101 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188da69-8405-4acf-b246-d60842f0d7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.775374 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188da69-8405-4acf-b246-d60842f0d7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.776085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188da69-8405-4acf-b246-d60842f0d7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:09.777652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188da69-8405-4acf-b246-d60842f0d7e2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:09.787974 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1349/2708] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:09.791987 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672670f-6a72-4d3f-a38a-04d26f8291de admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:09.802936 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672670f-6a72-4d3f-a38a-04d26f8291de admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:09.807461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0362-a824-435f-b6e5-6fb4878d0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:09.808406 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0362-a824-435f-b6e5-6fb4878d0333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.808751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0362-a824-435f-b6e5-6fb4878d0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.809029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0362-a824-435f-b6e5-6fb4878d0333 admin admin] PATH_INFO: `/v3/projects/e883afbfbb404293893f646f27902bc1/users/1b0007cfa751423da2f1bf78fbaa0f03/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.823418 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f0362-a824-435f-b6e5-6fb4878d0333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e883afbfbb404293893f646f27902bc1, user_id=1b0007cfa751423da2f1bf78fbaa0f03, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:09.826035 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f0362-a824-435f-b6e5-6fb4878d0333 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:09.839310 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1360/2709] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:19:09 2022] PUT /identity/v3/projects/e883afbfbb404293893f646f27902bc1/users/1b0007cfa751423da2f1bf78fbaa0f03/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:09.844970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4b63-39fd-440b-9abe-a977a0dd7f58 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.845283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4b63-39fd-440b-9abe-a977a0dd7f58 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.845562 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4b63-39fd-440b-9abe-a977a0dd7f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:09.863934 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9d6a4b63-39fd-440b-9abe-a977a0dd7f58 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:09.865116 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9d6a4b63-39fd-440b-9abe-a977a0dd7f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:09.923624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1350/2710] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:19:09.933081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0362-a824-435f-b6e5-6fb4878d0333 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:09.934783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d28f0362-a824-435f-b6e5-6fb4878d0333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:09.992306 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0362-a824-435f-b6e5-6fb4878d0333 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:09.995910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913ae12-f3e2-49d0-ae64-5bbb39079295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:09.996555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913ae12-f3e2-49d0-ae64-5bbb39079295 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:09.996835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913ae12-f3e2-49d0-ae64-5bbb39079295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:09.997108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913ae12-f3e2-49d0-ae64-5bbb39079295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:10.007445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913ae12-f3e2-49d0-ae64-5bbb39079295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:10.008825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913ae12-f3e2-49d0-ae64-5bbb39079295 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:10.018237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1361/2711] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:19:10.624315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856951-950c-477c-a175-9817363442ef None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:10.624600 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856951-950c-477c-a175-9817363442ef None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:10.624879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856951-950c-477c-a175-9817363442ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:10.651495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-06856951-950c-477c-a175-9817363442ef None None] MFA Rules not processed for user `1b0007cfa751423da2f1bf78fbaa0f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:10.652997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-06856951-950c-477c-a175-9817363442ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:10.726356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1351/2712] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:10.730848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913ae12-f3e2-49d0-ae64-5bbb39079295 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:10.736359 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:10.741489 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913ae12-f3e2-49d0-ae64-5bbb39079295 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:10.748309 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35230c97-d0c6-43aa-8d86-6c05f664bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:10.749074 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35230c97-d0c6-43aa-8d86-6c05f664bdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:10.749582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35230c97-d0c6-43aa-8d86-6c05f664bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:10.750133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35230c97-d0c6-43aa-8d86-6c05f664bdd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:10.751070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35230c97-d0c6-43aa-8d86-6c05f664bdd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:10.753283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35230c97-d0c6-43aa-8d86-6c05f664bdd1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:10.784094 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1362/2713] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:19:10 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:19:10.785550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06856951-950c-477c-a175-9817363442ef None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:10.798462 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06856951-950c-477c-a175-9817363442ef None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:10.803274 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:10.857055 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7df6d-5781-485f-89b8-074003a243a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:10.858371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7df6d-5781-485f-89b8-074003a243a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:10.858655 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7df6d-5781-485f-89b8-074003a243a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:10.858962 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7df6d-5781-485f-89b8-074003a243a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:10.859669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7df6d-5781-485f-89b8-074003a243a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:10.861593 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7df6d-5781-485f-89b8-074003a243a2 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:10.882394 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1352/2714] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:19:10 2022] POST /identity/v3/users => generated 307 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:19:10.886393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35230c97-d0c6-43aa-8d86-6c05f664bdd1 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:10.897127 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35230c97-d0c6-43aa-8d86-6c05f664bdd1 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:10.901660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360f96-d915-43e9-8ca0-5b22c4b51fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:10.902251 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360f96-d915-43e9-8ca0-5b22c4b51fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:10.902521 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360f96-d915-43e9-8ca0-5b22c4b51fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:10.902829 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360f96-d915-43e9-8ca0-5b22c4b51fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:10.903545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f360f96-d915-43e9-8ca0-5b22c4b51fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:10.906190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f360f96-d915-43e9-8ca0-5b22c4b51fb5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:10.916569 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1363/2715] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:10.920916 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7df6d-5781-485f-89b8-074003a243a2 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:10.930897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7df6d-5781-485f-89b8-074003a243a2 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:10.935690 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad33eb-c626-4269-b9c7-781aff15bc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:10.936603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad33eb-c626-4269-b9c7-781aff15bc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:10.936888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad33eb-c626-4269-b9c7-781aff15bc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:10.937167 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad33eb-c626-4269-b9c7-781aff15bc0b admin admin] PATH_INFO: `/v3/projects/91d4030a9e6546e0846a76a566ab14de/users/9b4da13d3f844090ad11cdae296fa293/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:10.952880 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad33eb-c626-4269-b9c7-781aff15bc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d4030a9e6546e0846a76a566ab14de, user_id=9b4da13d3f844090ad11cdae296fa293, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:10.955601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad33eb-c626-4269-b9c7-781aff15bc0b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:10.968928 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1353/2716] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:19:10 2022] PUT /identity/v3/projects/91d4030a9e6546e0846a76a566ab14de/users/9b4da13d3f844090ad11cdae296fa293/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:19:10.972782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360f96-d915-43e9-8ca0-5b22c4b51fb5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:10.983432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360f96-d915-43e9-8ca0-5b22c4b51fb5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:11.040296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3555e5b-8332-488c-bc52-30e354cb02fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:11.040954 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3555e5b-8332-488c-bc52-30e354cb02fb admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:11.041236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3555e5b-8332-488c-bc52-30e354cb02fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:11.041515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3555e5b-8332-488c-bc52-30e354cb02fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:11.042225 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3555e5b-8332-488c-bc52-30e354cb02fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:11.043842 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3555e5b-8332-488c-bc52-30e354cb02fb admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:11.053839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1364/2717] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:11.057896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad33eb-c626-4269-b9c7-781aff15bc0b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:11.070738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad33eb-c626-4269-b9c7-781aff15bc0b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:11.075371 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b6ef4-3d61-4d9b-8eb1-f7cb3ff526cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:11.076303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b6ef4-3d61-4d9b-8eb1-f7cb3ff526cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:11.076582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b6ef4-3d61-4d9b-8eb1-f7cb3ff526cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:11.076853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b6ef4-3d61-4d9b-8eb1-f7cb3ff526cc admin admin] PATH_INFO: `/v3/projects/91d4030a9e6546e0846a76a566ab14de/users/9b4da13d3f844090ad11cdae296fa293/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:11.078827 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b6ef4-3d61-4d9b-8eb1-f7cb3ff526cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d4030a9e6546e0846a76a566ab14de, user_id=9b4da13d3f844090ad11cdae296fa293, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:11.081431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b6ef4-3d61-4d9b-8eb1-f7cb3ff526cc admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:11.092914 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1354/2718] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:19:11 2022] PUT /identity/v3/projects/91d4030a9e6546e0846a76a566ab14de/users/9b4da13d3f844090ad11cdae296fa293/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:11.714901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4770-8637-4001-82a1-9d725cf18919 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:11.715312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4770-8637-4001-82a1-9d725cf18919 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:11.715594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4770-8637-4001-82a1-9d725cf18919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:11.742837 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-781e4770-8637-4001-82a1-9d725cf18919 None None] MFA Rules not processed for user `9b4da13d3f844090ad11cdae296fa293`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:11.744055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-781e4770-8637-4001-82a1-9d725cf18919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:11.815658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1365/2719] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:12.253270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b6ef4-3d61-4d9b-8eb1-f7cb3ff526cc admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:12.255178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-359b6ef4-3d61-4d9b-8eb1-f7cb3ff526cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:12.338212 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b6ef4-3d61-4d9b-8eb1-f7cb3ff526cc admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:12.344157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5dc26-0dee-43ae-9471-ea49171ecbbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:12.344849 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5dc26-0dee-43ae-9471-ea49171ecbbc service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:12.345133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5dc26-0dee-43ae-9471-ea49171ecbbc service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:12.345406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5dc26-0dee-43ae-9471-ea49171ecbbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:12.347435 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-36b5dc26-0dee-43ae-9471-ea49171ecbbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:12.360759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5dc26-0dee-43ae-9471-ea49171ecbbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:12.362390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5dc26-0dee-43ae-9471-ea49171ecbbc service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:12.372932 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1355/2720] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:19:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:19:12.827503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4770-8637-4001-82a1-9d725cf18919 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:12.878169 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:12.892887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4770-8637-4001-82a1-9d725cf18919 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:12.897391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:12.898257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:12.898537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:12.898843 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] PATH_INFO: `/v3/users/1b0007cfa751423da2f1bf78fbaa0f03` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:12.900036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0007cfa751423da2f1bf78fbaa0f03)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:12.901969 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:12.946542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0007cfa751423da2f1bf78fbaa0f03'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:12.947287 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0007cfa751423da2f1bf78fbaa0f03'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:12.954619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0007cfa751423da2f1bf78fbaa0f03'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:12.955270 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0007cfa751423da2f1bf78fbaa0f03'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:12.966958 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0007cfa751423da2f1bf78fbaa0f03'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:12.979100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1366/2721] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:19:12 2022] DELETE /identity/v3/users/1b0007cfa751423da2f1bf78fbaa0f03 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:13.145993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5dc26-0dee-43ae-9471-ea49171ecbbc service placement] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:13.157178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5dc26-0dee-43ae-9471-ea49171ecbbc service placement] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:13.211864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:13.223237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:13.224398 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:13.224681 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:13.224955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] PATH_INFO: `/v3/projects/e883afbfbb404293893f646f27902bc1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:13.226141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e883afbfbb404293893f646f27902bc1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:13.228059 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:13.272859 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e883afbfbb404293893f646f27902bc1', 'request_id': 'req-9cd0946c-c20c-4ac1-a753-6fa9a5565578'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.280696 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e883afbfbb404293893f646f27902bc1', 'request_id': 'req-9cd0946c-c20c-4ac1-a753-6fa9a5565578'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.286839 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e883afbfbb404293893f646f27902bc1', 'request_id': 'req-9cd0946c-c20c-4ac1-a753-6fa9a5565578'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.299352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] The token cache is being invalidate because project e883afbfbb404293893f646f27902bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:19:13.299634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.300265 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.301785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1356/2722] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:19:13 2022] DELETE /identity/v3/projects/e883afbfbb404293893f646f27902bc1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:13.306011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:13.310103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:13.324045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d46c53-2af0-4eae-ba62-34e13e020b1f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:13.380521 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:13.381663 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:13.381946 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:13.382224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] PATH_INFO: `/v3/users/9b4da13d3f844090ad11cdae296fa293` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:13.383413 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4da13d3f844090ad11cdae296fa293)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:13.385323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:13.432393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4da13d3f844090ad11cdae296fa293'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.433028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4da13d3f844090ad11cdae296fa293'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.440608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4da13d3f844090ad11cdae296fa293'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.441372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4da13d3f844090ad11cdae296fa293'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.452157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:13.453325 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-79238ef6-b945-4ff5-897b-aa7f85512d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4da13d3f844090ad11cdae296fa293'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.468091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1367/2723] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:19:13 2022] DELETE /identity/v3/users/9b4da13d3f844090ad11cdae296fa293 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:19:13.650012 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:13.651535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:13.664747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0946c-c20c-4ac1-a753-6fa9a5565578 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:13.722045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:13.722948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:13.723211 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:13.723500 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] PATH_INFO: `/v3/projects/91d4030a9e6546e0846a76a566ab14de` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:13.724668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d4030a9e6546e0846a76a566ab14de)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:13.726566 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:13.772822 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d4030a9e6546e0846a76a566ab14de', 'request_id': 'req-739f3fd8-4281-4687-b6d9-af67c81e67a3'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.780578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d4030a9e6546e0846a76a566ab14de', 'request_id': 'req-739f3fd8-4281-4687-b6d9-af67c81e67a3'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.786895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d4030a9e6546e0846a76a566ab14de', 'request_id': 'req-739f3fd8-4281-4687-b6d9-af67c81e67a3'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.797239 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] The token cache is being invalidate because project 91d4030a9e6546e0846a76a566ab14de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:19:13.797521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.798237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-739f3fd8-4281-4687-b6d9-af67c81e67a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:13.799795 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1357/2724] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:19:13 2022] DELETE /identity/v3/projects/91d4030a9e6546e0846a76a566ab14de => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:13.804824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba82518-9371-40fe-bd38-d5a7819a8c8c None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:13.805113 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba82518-9371-40fe-bd38-d5a7819a8c8c None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:13.805388 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba82518-9371-40fe-bd38-d5a7819a8c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:13.823668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-7ba82518-9371-40fe-bd38-d5a7819a8c8c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:13.824845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7ba82518-9371-40fe-bd38-d5a7819a8c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:13.882778 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1368/2725] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:13.891006 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e41d3-b21e-44bd-9b52-0022d8f86a8c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:13.891296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e41d3-b21e-44bd-9b52-0022d8f86a8c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:13.891575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e41d3-b21e-44bd-9b52-0022d8f86a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:13.909680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5f2e41d3-b21e-44bd-9b52-0022d8f86a8c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:13.910913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5f2e41d3-b21e-44bd-9b52-0022d8f86a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:13.918755 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1358/2726] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:13.923291 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba82518-9371-40fe-bd38-d5a7819a8c8c None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:13.933662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba82518-9371-40fe-bd38-d5a7819a8c8c None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:13.939174 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b8ca-dd98-464e-8f80-454b6f530d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:13.939823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b8ca-dd98-464e-8f80-454b6f530d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:13.940111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b8ca-dd98-464e-8f80-454b6f530d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:13.940391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b8ca-dd98-464e-8f80-454b6f530d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:13.941116 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7b8ca-dd98-464e-8f80-454b6f530d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:19:13.941427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7b8ca-dd98-464e-8f80-454b6f530d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:13.943058 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7b8ca-dd98-464e-8f80-454b6f530d4b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:13.954650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1369/2727] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:19:13.958766 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e41d3-b21e-44bd-9b52-0022d8f86a8c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:13.964310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:13.968448 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e41d3-b21e-44bd-9b52-0022d8f86a8c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:13.974485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77116b5-4c7d-4e62-8d6b-5d462dec8ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:13.975200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77116b5-4c7d-4e62-8d6b-5d462dec8ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:13.975667 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77116b5-4c7d-4e62-8d6b-5d462dec8ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:13.976113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77116b5-4c7d-4e62-8d6b-5d462dec8ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:13.977090 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77116b5-4c7d-4e62-8d6b-5d462dec8ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:13.979072 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77116b5-4c7d-4e62-8d6b-5d462dec8ae9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.005054 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1359/2728] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:19:13 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:19:14.009550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b8ca-dd98-464e-8f80-454b6f530d4b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.019560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b8ca-dd98-464e-8f80-454b6f530d4b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.075971 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88d940-650b-48a5-bf10-c5476120db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.076718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d940-650b-48a5-bf10-c5476120db44 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.077008 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d940-650b-48a5-bf10-c5476120db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.077285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d940-650b-48a5-bf10-c5476120db44 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.077976 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88d940-650b-48a5-bf10-c5476120db44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.079937 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88d940-650b-48a5-bf10-c5476120db44 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.099683 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1370/2729] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:19:14 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:19:14.103682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77116b5-4c7d-4e62-8d6b-5d462dec8ae9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.114495 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77116b5-4c7d-4e62-8d6b-5d462dec8ae9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.119073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0f3b-3cd9-40d2-8a46-e817dc2178e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.119726 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0f3b-3cd9-40d2-8a46-e817dc2178e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.120008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0f3b-3cd9-40d2-8a46-e817dc2178e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.120283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0f3b-3cd9-40d2-8a46-e817dc2178e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.120998 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e0f3b-3cd9-40d2-8a46-e817dc2178e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.122575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e0f3b-3cd9-40d2-8a46-e817dc2178e4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.133737 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1360/2730] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:14.137509 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88d940-650b-48a5-bf10-c5476120db44 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.147449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88d940-650b-48a5-bf10-c5476120db44 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.152055 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2caa31-9793-4990-801d-19e912de44c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.152688 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2caa31-9793-4990-801d-19e912de44c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.152975 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2caa31-9793-4990-801d-19e912de44c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.153252 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2caa31-9793-4990-801d-19e912de44c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.153970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2caa31-9793-4990-801d-19e912de44c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.155811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2caa31-9793-4990-801d-19e912de44c7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.165534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1371/2731] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:14.170198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0f3b-3cd9-40d2-8a46-e817dc2178e4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.180273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0f3b-3cd9-40d2-8a46-e817dc2178e4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.187109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61e53d-c212-4f1e-9dfc-1f84ce7456f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.189350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61e53d-c212-4f1e-9dfc-1f84ce7456f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.189350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61e53d-c212-4f1e-9dfc-1f84ce7456f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.189350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61e53d-c212-4f1e-9dfc-1f84ce7456f9 admin admin] PATH_INFO: `/v3/projects/6bead8c1c4d54226bdfece675d3292d8/users/132f4a8e47d54d4f9eadcdaeafe97877/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.204252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61e53d-c212-4f1e-9dfc-1f84ce7456f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bead8c1c4d54226bdfece675d3292d8, user_id=132f4a8e47d54d4f9eadcdaeafe97877, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.206926 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61e53d-c212-4f1e-9dfc-1f84ce7456f9 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.219888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1361/2732] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:19:14 2022] PUT /identity/v3/projects/6bead8c1c4d54226bdfece675d3292d8/users/132f4a8e47d54d4f9eadcdaeafe97877/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:14.231043 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e29224-2098-486c-8037-cf479b02a717 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.231337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e29224-2098-486c-8037-cf479b02a717 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.231615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e29224-2098-486c-8037-cf479b02a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.259790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-92e29224-2098-486c-8037-cf479b02a717 None None] MFA Rules not processed for user `132f4a8e47d54d4f9eadcdaeafe97877`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:14.260973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-92e29224-2098-486c-8037-cf479b02a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:14.305331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:14.327786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1372/2733] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:14.332218 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61e53d-c212-4f1e-9dfc-1f84ce7456f9 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.394361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61e53d-c212-4f1e-9dfc-1f84ce7456f9 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.398975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc619880-66c9-44b1-9a06-e29a2def7c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.399621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc619880-66c9-44b1-9a06-e29a2def7c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.399906 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc619880-66c9-44b1-9a06-e29a2def7c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.400178 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc619880-66c9-44b1-9a06-e29a2def7c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.400862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc619880-66c9-44b1-9a06-e29a2def7c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.402782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc619880-66c9-44b1-9a06-e29a2def7c75 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.429627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1362/2734] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:19:14 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:19:14.433667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e29224-2098-486c-8037-cf479b02a717 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.444697 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e29224-2098-486c-8037-cf479b02a717 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.500583 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209fb64-3022-4525-b960-9576d88a1bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.501243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fb64-3022-4525-b960-9576d88a1bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.501525 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fb64-3022-4525-b960-9576d88a1bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.501800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fb64-3022-4525-b960-9576d88a1bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.511514 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209fb64-3022-4525-b960-9576d88a1bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.512178 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209fb64-3022-4525-b960-9576d88a1bc1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.534393 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1373/2735] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:19:14 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:19:14.538344 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc619880-66c9-44b1-9a06-e29a2def7c75 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.549758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc619880-66c9-44b1-9a06-e29a2def7c75 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.554581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d2f80-2df8-4c32-9e9f-04f84cb35950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.555269 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d2f80-2df8-4c32-9e9f-04f84cb35950 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.555553 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d2f80-2df8-4c32-9e9f-04f84cb35950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.555829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d2f80-2df8-4c32-9e9f-04f84cb35950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.556540 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d2f80-2df8-4c32-9e9f-04f84cb35950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.558172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d2f80-2df8-4c32-9e9f-04f84cb35950 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.569723 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1363/2736] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:14.573600 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209fb64-3022-4525-b960-9576d88a1bc1 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.583526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209fb64-3022-4525-b960-9576d88a1bc1 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.588006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c4666-27cf-4de4-9666-fa0aacf6d7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.588905 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c4666-27cf-4de4-9666-fa0aacf6d7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.589186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c4666-27cf-4de4-9666-fa0aacf6d7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.589459 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c4666-27cf-4de4-9666-fa0aacf6d7a8 admin admin] PATH_INFO: `/v3/projects/7c0dd3cb756a4bc29dccca0628f7b190/users/4a9508a5be274f25bd81ffd443b86f7d/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.604505 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c4666-27cf-4de4-9666-fa0aacf6d7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0dd3cb756a4bc29dccca0628f7b190, user_id=4a9508a5be274f25bd81ffd443b86f7d, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.607274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c4666-27cf-4de4-9666-fa0aacf6d7a8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.621264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1374/2737] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:19:14 2022] PUT /identity/v3/projects/7c0dd3cb756a4bc29dccca0628f7b190/users/4a9508a5be274f25bd81ffd443b86f7d/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:14.625191 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d2f80-2df8-4c32-9e9f-04f84cb35950 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.635220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d2f80-2df8-4c32-9e9f-04f84cb35950 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.691201 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70114f0-1f75-4e89-8939-d50e11d63dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.691872 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70114f0-1f75-4e89-8939-d50e11d63dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.692141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70114f0-1f75-4e89-8939-d50e11d63dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.692420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70114f0-1f75-4e89-8939-d50e11d63dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.693132 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70114f0-1f75-4e89-8939-d50e11d63dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.694768 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70114f0-1f75-4e89-8939-d50e11d63dd6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.704894 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1364/2738] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:14.709336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c4666-27cf-4de4-9666-fa0aacf6d7a8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.720736 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c4666-27cf-4de4-9666-fa0aacf6d7a8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.725291 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5a7d3-41d8-43fc-bd65-00042047d1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.726160 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5a7d3-41d8-43fc-bd65-00042047d1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.726441 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5a7d3-41d8-43fc-bd65-00042047d1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.726741 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5a7d3-41d8-43fc-bd65-00042047d1c6 admin admin] PATH_INFO: `/v3/projects/7c0dd3cb756a4bc29dccca0628f7b190/users/4a9508a5be274f25bd81ffd443b86f7d/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.728671 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5a7d3-41d8-43fc-bd65-00042047d1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0dd3cb756a4bc29dccca0628f7b190, user_id=4a9508a5be274f25bd81ffd443b86f7d, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.731327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5a7d3-41d8-43fc-bd65-00042047d1c6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.741760 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1375/2739] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:19:14 2022] PUT /identity/v3/projects/7c0dd3cb756a4bc29dccca0628f7b190/users/4a9508a5be274f25bd81ffd443b86f7d/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:14.751993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535e6af-67eb-44b2-8cc2-8dc23bfb8c1e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.752280 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535e6af-67eb-44b2-8cc2-8dc23bfb8c1e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.752558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535e6af-67eb-44b2-8cc2-8dc23bfb8c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.779707 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b535e6af-67eb-44b2-8cc2-8dc23bfb8c1e None None] MFA Rules not processed for user `4a9508a5be274f25bd81ffd443b86f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:14.780913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b535e6af-67eb-44b2-8cc2-8dc23bfb8c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:14.785812 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:14.849465 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1365/2740] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:14.860526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5a7d3-41d8-43fc-bd65-00042047d1c6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:14.862245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-62c5a7d3-41d8-43fc-bd65-00042047d1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:14.918912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5a7d3-41d8-43fc-bd65-00042047d1c6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:14.922586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516be54f-840b-4ec2-be34-2af2bfe7c700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:14.923243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516be54f-840b-4ec2-be34-2af2bfe7c700 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:14.923526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516be54f-840b-4ec2-be34-2af2bfe7c700 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:14.923800 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516be54f-840b-4ec2-be34-2af2bfe7c700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:14.932641 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516be54f-840b-4ec2-be34-2af2bfe7c700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:14.934059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516be54f-840b-4ec2-be34-2af2bfe7c700 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:14.943640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1376/2741] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:19:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:19:15.016447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535e6af-67eb-44b2-8cc2-8dc23bfb8c1e None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:15.026160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535e6af-67eb-44b2-8cc2-8dc23bfb8c1e None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:15.030392 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c636920-4419-4e1d-9669-5b741553d648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:15.031053 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c636920-4419-4e1d-9669-5b741553d648 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:15.031338 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c636920-4419-4e1d-9669-5b741553d648 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:15.031614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c636920-4419-4e1d-9669-5b741553d648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:15.088410 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c636920-4419-4e1d-9669-5b741553d648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:15.089907 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c636920-4419-4e1d-9669-5b741553d648 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:15.098717 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1366/2742] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:19:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:19:24.939623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=77,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:25.094727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=54 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:28.821028 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516be54f-840b-4ec2-be34-2af2bfe7c700 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:28.823104 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-516be54f-840b-4ec2-be34-2af2bfe7c700 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:28.895807 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516be54f-840b-4ec2-be34-2af2bfe7c700 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:28.900379 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dbbb5-d2c6-4fec-8db3-c4460bb754fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:28.901039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dbbb5-d2c6-4fec-8db3-c4460bb754fa service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:28.901338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dbbb5-d2c6-4fec-8db3-c4460bb754fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:28.901627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dbbb5-d2c6-4fec-8db3-c4460bb754fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:28.903452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-cf5dbbb5-d2c6-4fec-8db3-c4460bb754fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:28.973267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dbbb5-d2c6-4fec-8db3-c4460bb754fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:28.974772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dbbb5-d2c6-4fec-8db3-c4460bb754fa service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:28.984494 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1377/2743] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:19:31.974254 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c636920-4419-4e1d-9669-5b741553d648 service cinder] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:31.975769 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-6c636920-4419-4e1d-9669-5b741553d648 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:31.990595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c636920-4419-4e1d-9669-5b741553d648 service cinder] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:31.996454 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:31.997471 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:31.997837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:31.998187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] PATH_INFO: `/v3/users/32e9879d092b4c819f1f5607f42cc364` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.000225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e9879d092b4c819f1f5607f42cc364)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:32.002156 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:32.063130 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e9879d092b4c819f1f5607f42cc364'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:32.072475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e9879d092b4c819f1f5607f42cc364'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:32.073286 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e9879d092b4c819f1f5607f42cc364'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:32.073966 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e9879d092b4c819f1f5607f42cc364'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:32.087597 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-178928df-d9d8-4aa6-ac16-cb2d4957f071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e9879d092b4c819f1f5607f42cc364'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:32.105549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1367/2744] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:19:31 2022] DELETE /identity/v3/users/32e9879d092b4c819f1f5607f42cc364 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:32.279255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dbbb5-d2c6-4fec-8db3-c4460bb754fa service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:32.290205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dbbb5-d2c6-4fec-8db3-c4460bb754fa service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:32.349915 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:32.350824 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:32.351096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:32.351375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] PATH_INFO: `/v3/projects/c69b4fff47194d4fbd1188521b31dce8` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.352546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69b4fff47194d4fbd1188521b31dce8)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:32.354473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:32.401483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69b4fff47194d4fbd1188521b31dce8', 'request_id': 'req-d324bdde-0f4f-483c-b32b-62cec7480fe0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:32.403992 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:32.409662 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69b4fff47194d4fbd1188521b31dce8', 'request_id': 'req-d324bdde-0f4f-483c-b32b-62cec7480fe0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:32.416184 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69b4fff47194d4fbd1188521b31dce8', 'request_id': 'req-d324bdde-0f4f-483c-b32b-62cec7480fe0'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:32.428356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] The token cache is being invalidate because project c69b4fff47194d4fbd1188521b31dce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:19:32.428709 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:32.429410 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-d324bdde-0f4f-483c-b32b-62cec7480fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:19:32.431285 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1378/2745] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:19:32 2022] DELETE /identity/v3/projects/c69b4fff47194d4fbd1188521b31dce8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:19:32.436987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655ff0a-c88a-443c-923f-4756ef33bf4f None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:32.437331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655ff0a-c88a-443c-923f-4756ef33bf4f None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:32.437621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655ff0a-c88a-443c-923f-4756ef33bf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.454815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-9655ff0a-c88a-443c-923f-4756ef33bf4f None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:32.456008 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-9655ff0a-c88a-443c-923f-4756ef33bf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:32.515278 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1368/2746] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:32.523508 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ec5d8-fa79-41a1-9105-41d805051695 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:32.523803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ec5d8-fa79-41a1-9105-41d805051695 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:32.524087 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ec5d8-fa79-41a1-9105-41d805051695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.544515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d57ec5d8-fa79-41a1-9105-41d805051695 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:32.545699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d57ec5d8-fa79-41a1-9105-41d805051695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:32.554546 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1379/2747] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:32.558785 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655ff0a-c88a-443c-923f-4756ef33bf4f None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:32.568713 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655ff0a-c88a-443c-923f-4756ef33bf4f None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:32.573197 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e950e-03b5-4ebe-8183-6827ec5d0dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:32.573843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e950e-03b5-4ebe-8183-6827ec5d0dda admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:32.574537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e950e-03b5-4ebe-8183-6827ec5d0dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:32.574857 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e950e-03b5-4ebe-8183-6827ec5d0dda admin admin] PATH_INFO: `/v3/domains` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.575581 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e950e-03b5-4ebe-8183-6827ec5d0dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:19:32.575889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e950e-03b5-4ebe-8183-6827ec5d0dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:32.577478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e950e-03b5-4ebe-8183-6827ec5d0dda admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:32.588882 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1369/2748] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:19:32.593111 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ec5d8-fa79-41a1-9105-41d805051695 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:32.602753 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ec5d8-fa79-41a1-9105-41d805051695 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:32.607364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f23d9-73b9-43f6-9eac-b94cd18b4007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:32.608010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f23d9-73b9-43f6-9eac-b94cd18b4007 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:32.608294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f23d9-73b9-43f6-9eac-b94cd18b4007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:32.608567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f23d9-73b9-43f6-9eac-b94cd18b4007 admin admin] PATH_INFO: `/v3/projects` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.609921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f23d9-73b9-43f6-9eac-b94cd18b4007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:32.611848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f23d9-73b9-43f6-9eac-b94cd18b4007 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:32.636911 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1380/2749] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:19:32 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:19:32.642043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e950e-03b5-4ebe-8183-6827ec5d0dda admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:32.651854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e950e-03b5-4ebe-8183-6827ec5d0dda admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:32.708030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aedd67-d266-47dc-a6ba-a2411795c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:32.708601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aedd67-d266-47dc-a6ba-a2411795c449 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:32.708886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aedd67-d266-47dc-a6ba-a2411795c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:32.709160 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aedd67-d266-47dc-a6ba-a2411795c449 admin admin] PATH_INFO: `/v3/users` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.709843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aedd67-d266-47dc-a6ba-a2411795c449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:32.711804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aedd67-d266-47dc-a6ba-a2411795c449 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:32.719007 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:32.734320 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1370/2750] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:19:32 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:19:32.737821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f23d9-73b9-43f6-9eac-b94cd18b4007 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:32.748020 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f23d9-73b9-43f6-9eac-b94cd18b4007 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:32.752796 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea418c49-ea40-4baa-bfba-7be0d93865ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:32.753452 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea418c49-ea40-4baa-bfba-7be0d93865ad admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:32.753735 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea418c49-ea40-4baa-bfba-7be0d93865ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:32.754013 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea418c49-ea40-4baa-bfba-7be0d93865ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.754764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea418c49-ea40-4baa-bfba-7be0d93865ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:32.756339 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea418c49-ea40-4baa-bfba-7be0d93865ad admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:32.767347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1381/2751] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:32.771433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aedd67-d266-47dc-a6ba-a2411795c449 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:32.782043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aedd67-d266-47dc-a6ba-a2411795c449 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:32.786669 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fe574-2d5b-401e-86cd-c7b5f3529b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:32.787354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fe574-2d5b-401e-86cd-c7b5f3529b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:32.787641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fe574-2d5b-401e-86cd-c7b5f3529b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:32.787918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fe574-2d5b-401e-86cd-c7b5f3529b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.788637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fe574-2d5b-401e-86cd-c7b5f3529b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:32.790248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fe574-2d5b-401e-86cd-c7b5f3529b00 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:32.800485 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1371/2752] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:19:32.804268 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea418c49-ea40-4baa-bfba-7be0d93865ad admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:32.814158 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea418c49-ea40-4baa-bfba-7be0d93865ad admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:32.818990 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa145b3-8612-4639-b8ef-8fad38fad5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:32.820545 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa145b3-8612-4639-b8ef-8fad38fad5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:32.821011 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa145b3-8612-4639-b8ef-8fad38fad5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:32.821297 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa145b3-8612-4639-b8ef-8fad38fad5d2 admin admin] PATH_INFO: `/v3/projects/0b2219c143d44ab09672beca155dfaca/users/9ce04aa758ca400786dfcc5e13d0cf10/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.841637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa145b3-8612-4639-b8ef-8fad38fad5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2219c143d44ab09672beca155dfaca, user_id=9ce04aa758ca400786dfcc5e13d0cf10, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:32.844942 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa145b3-8612-4639-b8ef-8fad38fad5d2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:32.859637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1382/2753] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:19:32 2022] PUT /identity/v3/projects/0b2219c143d44ab09672beca155dfaca/users/9ce04aa758ca400786dfcc5e13d0cf10/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:19:32.865016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676c996-29ec-419b-bc66-e92ac81ae23e None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:32.865409 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676c996-29ec-419b-bc66-e92ac81ae23e None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:32.865632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676c996-29ec-419b-bc66-e92ac81ae23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:32.884128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-b676c996-29ec-419b-bc66-e92ac81ae23e None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:32.885324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-b676c996-29ec-419b-bc66-e92ac81ae23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:32.948604 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1372/2754] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:32.959534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa145b3-8612-4639-b8ef-8fad38fad5d2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:32.961503 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-7aa145b3-8612-4639-b8ef-8fad38fad5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:33.024264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa145b3-8612-4639-b8ef-8fad38fad5d2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:33.028321 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f223-8163-43d5-bbd3-2e30061d7792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:33.029128 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f223-8163-43d5-bbd3-2e30061d7792 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:33.029489 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f223-8163-43d5-bbd3-2e30061d7792 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:33.029489 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f223-8163-43d5-bbd3-2e30061d7792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:33.040421 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564f223-8163-43d5-bbd3-2e30061d7792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:33.041876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564f223-8163-43d5-bbd3-2e30061d7792 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:33.051987 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1383/2755] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:19:37.137028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19a608-5678-4e05-9e06-d07dcaa38a11 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:37.137517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19a608-5678-4e05-9e06-d07dcaa38a11 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:37.137701 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19a608-5678-4e05-9e06-d07dcaa38a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:37.171285 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1f19a608-5678-4e05-9e06-d07dcaa38a11 None None] MFA Rules not processed for user `9ce04aa758ca400786dfcc5e13d0cf10`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:37.172568 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1f19a608-5678-4e05-9e06-d07dcaa38a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:37.261128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1373/2756] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:37.269295 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f223-8163-43d5-bbd3-2e30061d7792 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:19:37.271511 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b564f223-8163-43d5-bbd3-2e30061d7792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:37.357316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f223-8163-43d5-bbd3-2e30061d7792 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:19:37.363165 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53abf-0442-43a3-90dd-78895be725ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:19:37.364157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53abf-0442-43a3-90dd-78895be725ec service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:37.364647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53abf-0442-43a3-90dd-78895be725ec service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:37.365132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53abf-0442-43a3-90dd-78895be725ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:37.374186 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b53abf-0442-43a3-90dd-78895be725ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:19:37.376653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b53abf-0442-43a3-90dd-78895be725ec service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:19:37.388749 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1384/2757] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:19:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:19:38.787561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adc1f4-560c-4c99-8195-b7ce14de0001 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:19:38.788412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adc1f4-560c-4c99-8195-b7ce14de0001 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:19:38.788688 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adc1f4-560c-4c99-8195-b7ce14de0001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:19:38.807648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-e8adc1f4-560c-4c99-8195-b7ce14de0001 None None] MFA Rules not processed for user `9ce04aa758ca400786dfcc5e13d0cf10`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:19:38.808843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e8adc1f4-560c-4c99-8195-b7ce14de0001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:19:38.815864 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1374/2758] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:19:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:19:47.383857 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:19:48.801104 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:01.942302 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53abf-0442-43a3-90dd-78895be725ec service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:01.943744 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a0b53abf-0442-43a3-90dd-78895be725ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:02.021615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53abf-0442-43a3-90dd-78895be725ec service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:02.026190 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:02.027091 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:02.027375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:02.027645 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] PATH_INFO: `/v3/users/132f4a8e47d54d4f9eadcdaeafe97877` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:02.028834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132f4a8e47d54d4f9eadcdaeafe97877)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:02.031332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:02.078745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132f4a8e47d54d4f9eadcdaeafe97877'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.079476 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132f4a8e47d54d4f9eadcdaeafe97877'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.086254 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132f4a8e47d54d4f9eadcdaeafe97877'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.086901 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132f4a8e47d54d4f9eadcdaeafe97877'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.099303 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132f4a8e47d54d4f9eadcdaeafe97877'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.112492 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1385/2759] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:20:01 2022] DELETE /identity/v3/users/132f4a8e47d54d4f9eadcdaeafe97877 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:02.116735 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8206-7b38-4d6c-ad57-cec46af80931 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:02.117229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8206-7b38-4d6c-ad57-cec46af80931 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:02.117340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8206-7b38-4d6c-ad57-cec46af80931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:02.143506 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1a1b8206-7b38-4d6c-ad57-cec46af80931 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:02.144706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1a1b8206-7b38-4d6c-ad57-cec46af80931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:02.208834 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1375/2760] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:02.219082 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:02.220769 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:02.296619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:02.318567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe215df1-9f2c-49c0-a594-2eb1dcb421f9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:02.322162 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501b8e9-cfe0-4c01-9a91-19eb2a39e2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:02.322839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501b8e9-cfe0-4c01-9a91-19eb2a39e2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:02.323125 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501b8e9-cfe0-4c01-9a91-19eb2a39e2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:02.323404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501b8e9-cfe0-4c01-9a91-19eb2a39e2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:02.332878 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501b8e9-cfe0-4c01-9a91-19eb2a39e2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:02.334257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501b8e9-cfe0-4c01-9a91-19eb2a39e2f2 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:02.343609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1386/2761] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:20:02.614386 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8206-7b38-4d6c-ad57-cec46af80931 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:02.615836 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1a1b8206-7b38-4d6c-ad57-cec46af80931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:02.628671 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8206-7b38-4d6c-ad57-cec46af80931 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:02.634158 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:02.635166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:02.635475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:02.635753 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] PATH_INFO: `/v3/projects/6bead8c1c4d54226bdfece675d3292d8` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:02.636937 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bead8c1c4d54226bdfece675d3292d8)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:02.638913 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:02.689128 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bead8c1c4d54226bdfece675d3292d8', 'request_id': 'req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.695798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bead8c1c4d54226bdfece675d3292d8', 'request_id': 'req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.701895 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bead8c1c4d54226bdfece675d3292d8', 'request_id': 'req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.712210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] The token cache is being invalidate because project 6bead8c1c4d54226bdfece675d3292d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:20:02.712497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.713136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.714647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1376/2762] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:20:02 2022] DELETE /identity/v3/projects/6bead8c1c4d54226bdfece675d3292d8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:02.718543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501b8e9-cfe0-4c01-9a91-19eb2a39e2f2 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:02.728391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501b8e9-cfe0-4c01-9a91-19eb2a39e2f2 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:02.785445 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:02.786323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:02.786608 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:02.786973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] PATH_INFO: `/v3/users/4a9508a5be274f25bd81ffd443b86f7d` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:02.788146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9508a5be274f25bd81ffd443b86f7d)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:02.790085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:02.835296 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9508a5be274f25bd81ffd443b86f7d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.835928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9508a5be274f25bd81ffd443b86f7d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.842648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9508a5be274f25bd81ffd443b86f7d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.843298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9508a5be274f25bd81ffd443b86f7d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.854813 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0df51c83-22d4-461d-b65a-e04f90ae6faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9508a5be274f25bd81ffd443b86f7d'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:02.867775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1387/2763] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:20:02 2022] DELETE /identity/v3/users/4a9508a5be274f25bd81ffd443b86f7d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:03.369663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:03.371251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:03.385830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f59e58-e8dd-4851-ba5f-f0edfabad33a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:03.445601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:03.446455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:03.446764 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:03.447045 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] PATH_INFO: `/v3/projects/7c0dd3cb756a4bc29dccca0628f7b190` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:03.448233 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0dd3cb756a4bc29dccca0628f7b190)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:03.450113 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:03.472981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:03.499692 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0dd3cb756a4bc29dccca0628f7b190', 'request_id': 'req-8f48f95e-472c-42b2-a9b8-6569da496b3b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:03.506591 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0dd3cb756a4bc29dccca0628f7b190', 'request_id': 'req-8f48f95e-472c-42b2-a9b8-6569da496b3b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:03.513126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0dd3cb756a4bc29dccca0628f7b190', 'request_id': 'req-8f48f95e-472c-42b2-a9b8-6569da496b3b'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:03.527520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] The token cache is being invalidate because project 7c0dd3cb756a4bc29dccca0628f7b190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:20:03.527807 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:03.528461 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8f48f95e-472c-42b2-a9b8-6569da496b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:03.530105 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1377/2764] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:20:03 2022] DELETE /identity/v3/projects/7c0dd3cb756a4bc29dccca0628f7b190 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:03.536238 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a429f-7654-4f46-b0b0-e630831b13c2 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:03.536722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a429f-7654-4f46-b0b0-e630831b13c2 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:03.536826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a429f-7654-4f46-b0b0-e630831b13c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:03.587280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-b26a429f-7654-4f46-b0b0-e630831b13c2 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:03.588504 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-b26a429f-7654-4f46-b0b0-e630831b13c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:03.619115 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:03.651382 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1388/2765] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:03.660504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5fa6-3e90-4daa-ace2-c64cf29abc36 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:03.660799 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5fa6-3e90-4daa-ace2-c64cf29abc36 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:03.661107 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5fa6-3e90-4daa-ace2-c64cf29abc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:03.679022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-fb0e5fa6-3e90-4daa-ace2-c64cf29abc36 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:03.680216 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fb0e5fa6-3e90-4daa-ace2-c64cf29abc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:03.688401 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1378/2766] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:03.692581 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a429f-7654-4f46-b0b0-e630831b13c2 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:03.702156 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a429f-7654-4f46-b0b0-e630831b13c2 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:03.707247 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048082a-3082-4fd2-945c-bfaaece8e73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:03.707924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048082a-3082-4fd2-945c-bfaaece8e73c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:03.708209 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048082a-3082-4fd2-945c-bfaaece8e73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:03.708487 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048082a-3082-4fd2-945c-bfaaece8e73c admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:03.709213 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048082a-3082-4fd2-945c-bfaaece8e73c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:20:03.709521 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048082a-3082-4fd2-945c-bfaaece8e73c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:03.711168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048082a-3082-4fd2-945c-bfaaece8e73c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:03.723144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1389/2767] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:20:03.727229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e5fa6-3e90-4daa-ace2-c64cf29abc36 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:03.736561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e5fa6-3e90-4daa-ace2-c64cf29abc36 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:03.741149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816b15-c7a9-4645-a2ba-1e0cc1a572cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:03.741788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816b15-c7a9-4645-a2ba-1e0cc1a572cd admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:03.742067 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816b15-c7a9-4645-a2ba-1e0cc1a572cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:03.742342 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816b15-c7a9-4645-a2ba-1e0cc1a572cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:03.743063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816b15-c7a9-4645-a2ba-1e0cc1a572cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:03.744931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816b15-c7a9-4645-a2ba-1e0cc1a572cd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:03.771837 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1379/2768] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:20:03 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:20:03.775777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048082a-3082-4fd2-945c-bfaaece8e73c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:03.785802 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048082a-3082-4fd2-945c-bfaaece8e73c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:03.840606 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fee52-690b-4f0d-9844-94d72a6a51a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:03.841313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fee52-690b-4f0d-9844-94d72a6a51a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:03.841598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fee52-690b-4f0d-9844-94d72a6a51a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:03.841874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fee52-690b-4f0d-9844-94d72a6a51a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:03.842561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fee52-690b-4f0d-9844-94d72a6a51a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:03.844537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fee52-690b-4f0d-9844-94d72a6a51a2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:03.863930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1390/2769] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:20:03 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:20:03.868029 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816b15-c7a9-4645-a2ba-1e0cc1a572cd admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:03.879091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816b15-c7a9-4645-a2ba-1e0cc1a572cd admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:03.883969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c88bf3-f0c5-4f8c-8bb8-9facd3226991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:03.884649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c88bf3-f0c5-4f8c-8bb8-9facd3226991 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:03.884935 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c88bf3-f0c5-4f8c-8bb8-9facd3226991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:03.885215 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c88bf3-f0c5-4f8c-8bb8-9facd3226991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:03.885981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c88bf3-f0c5-4f8c-8bb8-9facd3226991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:03.887632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c88bf3-f0c5-4f8c-8bb8-9facd3226991 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:03.900539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1380/2770] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:20:03.905329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fee52-690b-4f0d-9844-94d72a6a51a2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:03.916237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fee52-690b-4f0d-9844-94d72a6a51a2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:03.920850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f2612-19e1-4877-be66-3e2a3fdc7d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:03.921706 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f2612-19e1-4877-be66-3e2a3fdc7d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:03.922123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f2612-19e1-4877-be66-3e2a3fdc7d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:03.922352 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f2612-19e1-4877-be66-3e2a3fdc7d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:03.923124 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f2612-19e1-4877-be66-3e2a3fdc7d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:03.924860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f2612-19e1-4877-be66-3e2a3fdc7d5c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:03.938895 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1391/2771] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:20:03.942967 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c88bf3-f0c5-4f8c-8bb8-9facd3226991 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:03.954005 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c88bf3-f0c5-4f8c-8bb8-9facd3226991 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:03.958528 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5960fe3-2a13-4c54-a98e-a822008ebb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:03.959427 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960fe3-2a13-4c54-a98e-a822008ebb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:03.959706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960fe3-2a13-4c54-a98e-a822008ebb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:03.959979 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960fe3-2a13-4c54-a98e-a822008ebb5b admin admin] PATH_INFO: `/v3/projects/d623752126574895ab1dac1b1dd3aff8/users/e56de4e073df472abf1ab0408875dc25/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:03.974455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5960fe3-2a13-4c54-a98e-a822008ebb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d623752126574895ab1dac1b1dd3aff8, user_id=e56de4e073df472abf1ab0408875dc25, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:03.977106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5960fe3-2a13-4c54-a98e-a822008ebb5b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:03.990076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1381/2772] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:20:03 2022] PUT /identity/v3/projects/d623752126574895ab1dac1b1dd3aff8/users/e56de4e073df472abf1ab0408875dc25/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:04.000742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c8818-f96a-47d7-ba9a-8697df8e5ddf None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:04.001065 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c8818-f96a-47d7-ba9a-8697df8e5ddf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:04.001347 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c8818-f96a-47d7-ba9a-8697df8e5ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:04.028427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-800c8818-f96a-47d7-ba9a-8697df8e5ddf None None] MFA Rules not processed for user `e56de4e073df472abf1ab0408875dc25`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:04.029556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-800c8818-f96a-47d7-ba9a-8697df8e5ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:04.092318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1392/2773] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:04.097002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5960fe3-2a13-4c54-a98e-a822008ebb5b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:04.159068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5960fe3-2a13-4c54-a98e-a822008ebb5b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:04.163841 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98205-8be2-417e-864a-be8ca33a1806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:04.164492 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98205-8be2-417e-864a-be8ca33a1806 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:04.164775 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98205-8be2-417e-864a-be8ca33a1806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:04.165050 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98205-8be2-417e-864a-be8ca33a1806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:04.165747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98205-8be2-417e-864a-be8ca33a1806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:04.167673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98205-8be2-417e-864a-be8ca33a1806 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:04.197324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1382/2774] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:20:04 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:20:04.198520 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c8818-f96a-47d7-ba9a-8697df8e5ddf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:04.209629 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c8818-f96a-47d7-ba9a-8697df8e5ddf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:04.240680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:04.272596 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb7f1-9786-435d-b6ba-7bd78ba87959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:04.273319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb7f1-9786-435d-b6ba-7bd78ba87959 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:04.273603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb7f1-9786-435d-b6ba-7bd78ba87959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:04.273912 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb7f1-9786-435d-b6ba-7bd78ba87959 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:04.274604 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb7f1-9786-435d-b6ba-7bd78ba87959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:04.276562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb7f1-9786-435d-b6ba-7bd78ba87959 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:04.298108 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1393/2775] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:20:04 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:20:04.302009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98205-8be2-417e-864a-be8ca33a1806 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:04.312975 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98205-8be2-417e-864a-be8ca33a1806 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:04.317444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1cd17-4497-4d05-a8ae-ba4e09b133a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:04.318085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1cd17-4497-4d05-a8ae-ba4e09b133a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:04.318366 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1cd17-4497-4d05-a8ae-ba4e09b133a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:04.318639 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1cd17-4497-4d05-a8ae-ba4e09b133a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:04.319381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1cd17-4497-4d05-a8ae-ba4e09b133a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:04.320955 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1cd17-4497-4d05-a8ae-ba4e09b133a1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:04.331291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1383/2776] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:20:04.335289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb7f1-9786-435d-b6ba-7bd78ba87959 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:04.345805 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb7f1-9786-435d-b6ba-7bd78ba87959 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:04.350328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5af0b-9e16-47f4-af27-5058adceab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:04.351231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5af0b-9e16-47f4-af27-5058adceab79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:04.351513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5af0b-9e16-47f4-af27-5058adceab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:04.351785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5af0b-9e16-47f4-af27-5058adceab79 admin admin] PATH_INFO: `/v3/projects/1c03ac0c22704b388a7c5decab9ceb6c/users/62599bd4b93448f3828f7253c82a7128/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:04.367498 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5af0b-9e16-47f4-af27-5058adceab79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c03ac0c22704b388a7c5decab9ceb6c, user_id=62599bd4b93448f3828f7253c82a7128, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:04.370206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5af0b-9e16-47f4-af27-5058adceab79 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:04.384262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1394/2777] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:20:04 2022] PUT /identity/v3/projects/1c03ac0c22704b388a7c5decab9ceb6c/users/62599bd4b93448f3828f7253c82a7128/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:04.388183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1cd17-4497-4d05-a8ae-ba4e09b133a1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:04.398117 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1cd17-4497-4d05-a8ae-ba4e09b133a1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:04.410136 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:04.457674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb4889-4e56-4844-b811-5e522999d1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:04.458358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb4889-4e56-4844-b811-5e522999d1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:04.458645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb4889-4e56-4844-b811-5e522999d1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:04.458954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb4889-4e56-4844-b811-5e522999d1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:04.459706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb4889-4e56-4844-b811-5e522999d1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:04.461327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb4889-4e56-4844-b811-5e522999d1ed admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:04.471650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1384/2778] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:20:04.475737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5af0b-9e16-47f4-af27-5058adceab79 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:04.486773 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5af0b-9e16-47f4-af27-5058adceab79 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:04.491391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91893dc-c6a2-4f92-a73f-048e28f15d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:04.492269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91893dc-c6a2-4f92-a73f-048e28f15d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:04.492553 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91893dc-c6a2-4f92-a73f-048e28f15d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:04.492830 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91893dc-c6a2-4f92-a73f-048e28f15d4c admin admin] PATH_INFO: `/v3/projects/1c03ac0c22704b388a7c5decab9ceb6c/users/62599bd4b93448f3828f7253c82a7128/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:04.494851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91893dc-c6a2-4f92-a73f-048e28f15d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c03ac0c22704b388a7c5decab9ceb6c, user_id=62599bd4b93448f3828f7253c82a7128, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:04.497481 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91893dc-c6a2-4f92-a73f-048e28f15d4c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:04.508786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1395/2779] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:20:04 2022] PUT /identity/v3/projects/1c03ac0c22704b388a7c5decab9ceb6c/users/62599bd4b93448f3828f7253c82a7128/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:04.520789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba4c9-f838-41a3-bbde-8508cae84d62 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:04.521317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba4c9-f838-41a3-bbde-8508cae84d62 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:04.521823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba4c9-f838-41a3-bbde-8508cae84d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:04.551682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-44dba4c9-f838-41a3-bbde-8508cae84d62 None None] MFA Rules not processed for user `62599bd4b93448f3828f7253c82a7128`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:04.552803 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-44dba4c9-f838-41a3-bbde-8508cae84d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:04.620020 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1385/2780] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:04.631336 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91893dc-c6a2-4f92-a73f-048e28f15d4c admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:04.633312 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c91893dc-c6a2-4f92-a73f-048e28f15d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:04.693041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91893dc-c6a2-4f92-a73f-048e28f15d4c admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:04.696689 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818fc7d-776d-40b5-9394-c3b1e2f37bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:04.697330 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818fc7d-776d-40b5-9394-c3b1e2f37bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:04.697616 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818fc7d-776d-40b5-9394-c3b1e2f37bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:04.697896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818fc7d-776d-40b5-9394-c3b1e2f37bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:04.706994 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818fc7d-776d-40b5-9394-c3b1e2f37bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:04.708426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818fc7d-776d-40b5-9394-c3b1e2f37bc8 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:04.717724 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1396/2781] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:20:04.789901 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba4c9-f838-41a3-bbde-8508cae84d62 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:04.800497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba4c9-f838-41a3-bbde-8508cae84d62 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:04.804164 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba57833-c809-4faa-8775-69a263e4f324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:04.804734 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba57833-c809-4faa-8775-69a263e4f324 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:04.805017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba57833-c809-4faa-8775-69a263e4f324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:04.805292 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba57833-c809-4faa-8775-69a263e4f324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:04.864147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba57833-c809-4faa-8775-69a263e4f324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:04.865582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba57833-c809-4faa-8775-69a263e4f324 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:04.874350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1386/2782] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:20:07.554039 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818fc7d-776d-40b5-9394-c3b1e2f37bc8 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:07.616062 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818fc7d-776d-40b5-9394-c3b1e2f37bc8 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:07.620913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:07.621808 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:07.622096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:07.622394 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] PATH_INFO: `/v3/users/e56de4e073df472abf1ab0408875dc25` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:07.623648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56de4e073df472abf1ab0408875dc25)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:07.625593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:07.653461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:07.676817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56de4e073df472abf1ab0408875dc25'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:07.677474 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56de4e073df472abf1ab0408875dc25'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:07.684307 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56de4e073df472abf1ab0408875dc25'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:07.684940 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56de4e073df472abf1ab0408875dc25'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:07.697002 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56de4e073df472abf1ab0408875dc25'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:07.709745 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1397/2783] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:20:07 2022] DELETE /identity/v3/users/e56de4e073df472abf1ab0408875dc25 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:07.714275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc943f-3deb-4c40-861a-cc6089a181c0 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:07.714888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc943f-3deb-4c40-861a-cc6089a181c0 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:07.714888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc943f-3deb-4c40-861a-cc6089a181c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:07.732365 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-72cc943f-3deb-4c40-861a-cc6089a181c0 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:07.733550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-72cc943f-3deb-4c40-861a-cc6089a181c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:07.766337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=100 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:07.794433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1387/2784] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:07.805085 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:07.806500 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:07.863171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb250ce-c215-445d-9a69-985a4534cff5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:07.866952 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9f9b6-bee3-498a-9774-cf7aee7dccc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:07.867653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9f9b6-bee3-498a-9774-cf7aee7dccc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:07.867939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9f9b6-bee3-498a-9774-cf7aee7dccc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:07.868214 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9f9b6-bee3-498a-9774-cf7aee7dccc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:07.877860 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9f9b6-bee3-498a-9774-cf7aee7dccc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:07.879338 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9f9b6-bee3-498a-9774-cf7aee7dccc2 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:07.888719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1398/2785] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:20:08.162608 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc943f-3deb-4c40-861a-cc6089a181c0 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:08.164179 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-72cc943f-3deb-4c40-861a-cc6089a181c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:08.177813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc943f-3deb-4c40-861a-cc6089a181c0 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:08.182425 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:08.183360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:08.183646 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:08.183918 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] PATH_INFO: `/v3/projects/d623752126574895ab1dac1b1dd3aff8` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:08.185078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d623752126574895ab1dac1b1dd3aff8)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:08.187522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:08.235421 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd623752126574895ab1dac1b1dd3aff8', 'request_id': 'req-a8b5c818-f6c3-4d20-9cad-e797be772227'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.243354 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd623752126574895ab1dac1b1dd3aff8', 'request_id': 'req-a8b5c818-f6c3-4d20-9cad-e797be772227'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.252196 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd623752126574895ab1dac1b1dd3aff8', 'request_id': 'req-a8b5c818-f6c3-4d20-9cad-e797be772227'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.263229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] The token cache is being invalidate because project d623752126574895ab1dac1b1dd3aff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:20:08.263525 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.264186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.266547 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1388/2786] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:20:08 2022] DELETE /identity/v3/projects/d623752126574895ab1dac1b1dd3aff8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:08.270541 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9f9b6-bee3-498a-9774-cf7aee7dccc2 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:08.280115 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9f9b6-bee3-498a-9774-cf7aee7dccc2 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:08.335775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:08.336628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:08.336916 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:08.337189 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] PATH_INFO: `/v3/users/62599bd4b93448f3828f7253c82a7128` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:08.338355 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62599bd4b93448f3828f7253c82a7128)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:08.340316 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:08.385701 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62599bd4b93448f3828f7253c82a7128'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.386342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62599bd4b93448f3828f7253c82a7128'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.387558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:08.394947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62599bd4b93448f3828f7253c82a7128'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.395848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62599bd4b93448f3828f7253c82a7128'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.408332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-bfba2750-897d-4ae0-9546-e26583e01371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62599bd4b93448f3828f7253c82a7128'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.420313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1399/2787] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:20:08 2022] DELETE /identity/v3/users/62599bd4b93448f3828f7253c82a7128 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:08.694722 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:08.696187 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:08.711688 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5c818-f6c3-4d20-9cad-e797be772227 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:08.769182 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:08.770051 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:08.770334 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:08.770760 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] PATH_INFO: `/v3/projects/1c03ac0c22704b388a7c5decab9ceb6c` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:08.771947 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c03ac0c22704b388a7c5decab9ceb6c)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:08.773844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:08.821217 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c03ac0c22704b388a7c5decab9ceb6c', 'request_id': 'req-4f5f30c4-63f9-4b87-83de-9074c059a42f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.828950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c03ac0c22704b388a7c5decab9ceb6c', 'request_id': 'req-4f5f30c4-63f9-4b87-83de-9074c059a42f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.835030 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c03ac0c22704b388a7c5decab9ceb6c', 'request_id': 'req-4f5f30c4-63f9-4b87-83de-9074c059a42f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.837009 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:08.848502 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] The token cache is being invalidate because project 1c03ac0c22704b388a7c5decab9ceb6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:20:08.848788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.849420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-4f5f30c4-63f9-4b87-83de-9074c059a42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:20:08.850988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1389/2788] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:20:08 2022] DELETE /identity/v3/projects/1c03ac0c22704b388a7c5decab9ceb6c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:08.858844 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93900ca8-b244-491f-a346-740fc3fdfc69 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:08.859559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93900ca8-b244-491f-a346-740fc3fdfc69 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:08.859559 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93900ca8-b244-491f-a346-740fc3fdfc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:08.877112 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-93900ca8-b244-491f-a346-740fc3fdfc69 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:08.878311 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-93900ca8-b244-491f-a346-740fc3fdfc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:08.935882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1400/2789] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:08.943629 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0efc0-19ea-4167-b6ca-800a1b8b95da None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:08.943858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0efc0-19ea-4167-b6ca-800a1b8b95da None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:08.944137 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0efc0-19ea-4167-b6ca-800a1b8b95da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:08.963363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-d5e0efc0-19ea-4167-b6ca-800a1b8b95da None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:08.964549 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-d5e0efc0-19ea-4167-b6ca-800a1b8b95da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:08.972417 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1390/2790] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:08.976472 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93900ca8-b244-491f-a346-740fc3fdfc69 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:08.986454 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93900ca8-b244-491f-a346-740fc3fdfc69 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:08.990986 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8e608-baa9-4ee8-b7f8-a064c379d9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:08.991642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8e608-baa9-4ee8-b7f8-a064c379d9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:08.991929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8e608-baa9-4ee8-b7f8-a064c379d9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:08.992206 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8e608-baa9-4ee8-b7f8-a064c379d9b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:08.992932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8e608-baa9-4ee8-b7f8-a064c379d9b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:20:08.993242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8e608-baa9-4ee8-b7f8-a064c379d9b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:08.994872 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8e608-baa9-4ee8-b7f8-a064c379d9b7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:09.006962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1401/2791] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:20:09.011582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0efc0-19ea-4167-b6ca-800a1b8b95da None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:09.021399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0efc0-19ea-4167-b6ca-800a1b8b95da None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:09.025994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac144e2-94bd-44c1-bfd1-4f84062a4271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:09.026641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac144e2-94bd-44c1-bfd1-4f84062a4271 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:09.026960 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac144e2-94bd-44c1-bfd1-4f84062a4271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:09.027237 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac144e2-94bd-44c1-bfd1-4f84062a4271 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:09.027969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac144e2-94bd-44c1-bfd1-4f84062a4271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:09.029858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac144e2-94bd-44c1-bfd1-4f84062a4271 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:09.057580 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1391/2792] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:20:09 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:20:09.058762 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8e608-baa9-4ee8-b7f8-a064c379d9b7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:09.069620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8e608-baa9-4ee8-b7f8-a064c379d9b7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:09.129879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f994-353e-421b-9e37-8aefb7a49ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:09.130542 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f994-353e-421b-9e37-8aefb7a49ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:09.130865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f994-353e-421b-9e37-8aefb7a49ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:09.131137 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f994-353e-421b-9e37-8aefb7a49ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:09.131826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685f994-353e-421b-9e37-8aefb7a49ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:09.133964 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685f994-353e-421b-9e37-8aefb7a49ae8 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:09.153699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1402/2793] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:20:09 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:20:09.157980 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac144e2-94bd-44c1-bfd1-4f84062a4271 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:09.168396 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac144e2-94bd-44c1-bfd1-4f84062a4271 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:09.173830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153540d-9828-462a-89ca-ce8ad266b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:09.174493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153540d-9828-462a-89ca-ce8ad266b465 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:09.174821 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153540d-9828-462a-89ca-ce8ad266b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:09.175100 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153540d-9828-462a-89ca-ce8ad266b465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:09.175823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153540d-9828-462a-89ca-ce8ad266b465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:09.177413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153540d-9828-462a-89ca-ce8ad266b465 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:09.188615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1392/2794] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:20:09.192642 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f994-353e-421b-9e37-8aefb7a49ae8 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:09.203342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f994-353e-421b-9e37-8aefb7a49ae8 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:09.207978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a5a6-58a8-4d9e-a9de-07ffd2696c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:09.208632 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a5a6-58a8-4d9e-a9de-07ffd2696c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:09.208921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a5a6-58a8-4d9e-a9de-07ffd2696c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:09.209195 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a5a6-58a8-4d9e-a9de-07ffd2696c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:09.209910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836a5a6-58a8-4d9e-a9de-07ffd2696c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:09.211513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836a5a6-58a8-4d9e-a9de-07ffd2696c8c admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:09.221563 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1403/2795] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:20:09.225845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153540d-9828-462a-89ca-ce8ad266b465 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:09.236064 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153540d-9828-462a-89ca-ce8ad266b465 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:09.240647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d633fa-3ab0-486b-a47c-a670be329271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:09.241554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d633fa-3ab0-486b-a47c-a670be329271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:09.241862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d633fa-3ab0-486b-a47c-a670be329271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:09.242140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d633fa-3ab0-486b-a47c-a670be329271 admin admin] PATH_INFO: `/v3/projects/9b4b5edf7a064c2eb276bdf2c418f26e/users/2f8e89084a2344cdb89889d7d5744b8b/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:09.258085 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d633fa-3ab0-486b-a47c-a670be329271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4b5edf7a064c2eb276bdf2c418f26e, user_id=2f8e89084a2344cdb89889d7d5744b8b, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:09.260752 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d633fa-3ab0-486b-a47c-a670be329271 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:09.274429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1393/2796] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:20:09 2022] PUT /identity/v3/projects/9b4b5edf7a064c2eb276bdf2c418f26e/users/2f8e89084a2344cdb89889d7d5744b8b/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:09.282237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423053a4-52c4-457b-89fd-46c706063f42 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:09.282619 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423053a4-52c4-457b-89fd-46c706063f42 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:09.283005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423053a4-52c4-457b-89fd-46c706063f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:09.301283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-423053a4-52c4-457b-89fd-46c706063f42 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:09.302517 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-423053a4-52c4-457b-89fd-46c706063f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:09.328573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:09.363785 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1404/2797] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:09.373518 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d633fa-3ab0-486b-a47c-a670be329271 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:09.375847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-30d633fa-3ab0-486b-a47c-a670be329271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:09.435079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d633fa-3ab0-486b-a47c-a670be329271 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:09.439458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2c963-72fc-41e4-b91e-30d733fd4de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:09.440444 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c963-72fc-41e4-b91e-30d733fd4de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:09.440804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c963-72fc-41e4-b91e-30d733fd4de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:09.441206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c963-72fc-41e4-b91e-30d733fd4de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:09.450680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2c963-72fc-41e4-b91e-30d733fd4de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:09.452131 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2c963-72fc-41e4-b91e-30d733fd4de6 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:09.461643 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1394/2798] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:20:13.472962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a992bb-7d0f-467f-ba44-d2efde9fd0e4 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:13.473495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a992bb-7d0f-467f-ba44-d2efde9fd0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:13.473495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a992bb-7d0f-467f-ba44-d2efde9fd0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:13.503030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-31a992bb-7d0f-467f-ba44-d2efde9fd0e4 None None] MFA Rules not processed for user `2f8e89084a2344cdb89889d7d5744b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:13.504243 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-31a992bb-7d0f-467f-ba44-d2efde9fd0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:13.580803 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1405/2799] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:13.585756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2c963-72fc-41e4-b91e-30d733fd4de6 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:13.596737 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2c963-72fc-41e4-b91e-30d733fd4de6 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:13.601905 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0700f5-8c0c-4a77-98a3-1c3990681c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:13.602582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0700f5-8c0c-4a77-98a3-1c3990681c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:13.602897 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0700f5-8c0c-4a77-98a3-1c3990681c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:13.603175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0700f5-8c0c-4a77-98a3-1c3990681c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:13.603876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0700f5-8c0c-4a77-98a3-1c3990681c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:13.605823 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0700f5-8c0c-4a77-98a3-1c3990681c7b admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:13.634749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1395/2800] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:20:13 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:20:13.638822 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a992bb-7d0f-467f-ba44-d2efde9fd0e4 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:13.649806 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a992bb-7d0f-467f-ba44-d2efde9fd0e4 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:13.713001 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce82f3-0bb5-4e1f-a831-a35751f50976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:13.713691 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce82f3-0bb5-4e1f-a831-a35751f50976 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:13.713978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce82f3-0bb5-4e1f-a831-a35751f50976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:13.714257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce82f3-0bb5-4e1f-a831-a35751f50976 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:13.714984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce82f3-0bb5-4e1f-a831-a35751f50976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:13.717081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce82f3-0bb5-4e1f-a831-a35751f50976 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:13.740434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1406/2801] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:20:13 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:20:13.744550 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0700f5-8c0c-4a77-98a3-1c3990681c7b admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:13.755367 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0700f5-8c0c-4a77-98a3-1c3990681c7b admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:13.760279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530f781-a0a5-4f8f-9a91-3d4a00d10376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:13.760941 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530f781-a0a5-4f8f-9a91-3d4a00d10376 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:13.761227 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530f781-a0a5-4f8f-9a91-3d4a00d10376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:13.761530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530f781-a0a5-4f8f-9a91-3d4a00d10376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:13.762249 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530f781-a0a5-4f8f-9a91-3d4a00d10376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:13.763898 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530f781-a0a5-4f8f-9a91-3d4a00d10376 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:13.774486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1396/2802] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:20:13.778526 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce82f3-0bb5-4e1f-a831-a35751f50976 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:13.789470 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce82f3-0bb5-4e1f-a831-a35751f50976 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:13.794141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483f162-8f79-4920-86ea-836648d52a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:13.795047 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483f162-8f79-4920-86ea-836648d52a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:13.795332 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483f162-8f79-4920-86ea-836648d52a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:13.795611 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483f162-8f79-4920-86ea-836648d52a4d admin admin] PATH_INFO: `/v3/projects/bbfbd281f6bb4bcd8633f4329fdad888/users/e4dd471c0d894e8b9bb7ab08bfa223d8/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:13.811060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483f162-8f79-4920-86ea-836648d52a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfbd281f6bb4bcd8633f4329fdad888, user_id=e4dd471c0d894e8b9bb7ab08bfa223d8, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:13.813834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483f162-8f79-4920-86ea-836648d52a4d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:13.827100 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1407/2803] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:20:13 2022] PUT /identity/v3/projects/bbfbd281f6bb4bcd8633f4329fdad888/users/e4dd471c0d894e8b9bb7ab08bfa223d8/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:20:13.831765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530f781-a0a5-4f8f-9a91-3d4a00d10376 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:13.841706 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530f781-a0a5-4f8f-9a91-3d4a00d10376 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:13.892903 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:13.899994 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf72b0f-5b75-4aac-b4ce-645e92a152a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:13.900853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf72b0f-5b75-4aac-b4ce-645e92a152a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:13.901327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf72b0f-5b75-4aac-b4ce-645e92a152a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:13.901649 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf72b0f-5b75-4aac-b4ce-645e92a152a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:13.902521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf72b0f-5b75-4aac-b4ce-645e92a152a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:13.904327 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf72b0f-5b75-4aac-b4ce-645e92a152a4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:13.914109 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1397/2804] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:20:13.918513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483f162-8f79-4920-86ea-836648d52a4d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:13.929477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483f162-8f79-4920-86ea-836648d52a4d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:13.934417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9020936-8bdb-4c5d-a196-62fe86233bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:13.935411 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9020936-8bdb-4c5d-a196-62fe86233bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:13.935680 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9020936-8bdb-4c5d-a196-62fe86233bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:13.935913 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9020936-8bdb-4c5d-a196-62fe86233bbf admin admin] PATH_INFO: `/v3/projects/bbfbd281f6bb4bcd8633f4329fdad888/users/e4dd471c0d894e8b9bb7ab08bfa223d8/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:13.938821 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9020936-8bdb-4c5d-a196-62fe86233bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfbd281f6bb4bcd8633f4329fdad888, user_id=e4dd471c0d894e8b9bb7ab08bfa223d8, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:13.941486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9020936-8bdb-4c5d-a196-62fe86233bbf admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:13.952460 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1408/2805] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:20:13 2022] PUT /identity/v3/projects/bbfbd281f6bb4bcd8633f4329fdad888/users/e4dd471c0d894e8b9bb7ab08bfa223d8/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:20:18.491273 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f68b0-e0fb-4713-b32b-390c66c9140c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:18.491776 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f68b0-e0fb-4713-b32b-390c66c9140c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:18.491867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f68b0-e0fb-4713-b32b-390c66c9140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:18.523539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-808f68b0-e0fb-4713-b32b-390c66c9140c None None] MFA Rules not processed for user `e4dd471c0d894e8b9bb7ab08bfa223d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:18.525192 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-808f68b0-e0fb-4713-b32b-390c66c9140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:18.618736 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1398/2806] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:18.633586 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9020936-8bdb-4c5d-a196-62fe86233bbf admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:18.635396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d9020936-8bdb-4c5d-a196-62fe86233bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:18.650839 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:18.722318 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9020936-8bdb-4c5d-a196-62fe86233bbf admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:18.728415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0609b1-b381-4413-a34e-942facd64ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:18.729069 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0609b1-b381-4413-a34e-942facd64ae7 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:18.729467 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0609b1-b381-4413-a34e-942facd64ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:18.729747 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0609b1-b381-4413-a34e-942facd64ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:18.798262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0609b1-b381-4413-a34e-942facd64ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:18.800110 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0609b1-b381-4413-a34e-942facd64ae7 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:18.811396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1409/2807] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:20:19.777118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be06c53-1073-4214-b464-a5fb1f1c6b91 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:19.777595 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be06c53-1073-4214-b464-a5fb1f1c6b91 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:19.777695 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be06c53-1073-4214-b464-a5fb1f1c6b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:19.795642 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-1be06c53-1073-4214-b464-a5fb1f1c6b91 None None] MFA Rules not processed for user `2f8e89084a2344cdb89889d7d5744b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:20:19.797551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1be06c53-1073-4214-b464-a5fb1f1c6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:19.804376 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1399/2808] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:20:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:20:28.806448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=50 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:29.790415 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=40 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:20:48.256217 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0609b1-b381-4413-a34e-942facd64ae7 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:48.257573 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-bd0609b1-b381-4413-a34e-942facd64ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:48.334560 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0609b1-b381-4413-a34e-942facd64ae7 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:48.339635 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b0ec-49a8-45b3-958b-fe8e132cb9a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:48.340400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b0ec-49a8-45b3-958b-fe8e132cb9a6 service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:48.340681 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b0ec-49a8-45b3-958b-fe8e132cb9a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:48.340955 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b0ec-49a8-45b3-958b-fe8e132cb9a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:48.342730 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-45f5b0ec-49a8-45b3-958b-fe8e132cb9a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:48.354245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5b0ec-49a8-45b3-958b-fe8e132cb9a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:48.355854 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5b0ec-49a8-45b3-958b-fe8e132cb9a6 service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:48.366182 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1410/2809] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:20:50.801858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be06c53-1073-4214-b464-a5fb1f1c6b91 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:50.803473 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1be06c53-1073-4214-b464-a5fb1f1c6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:50.873907 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be06c53-1073-4214-b464-a5fb1f1c6b91 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:50.881016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84195a8d-c09b-476f-9045-4a234200ec42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:50.881674 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195a8d-c09b-476f-9045-4a234200ec42 service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:50.881952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195a8d-c09b-476f-9045-4a234200ec42 service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:50.882223 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195a8d-c09b-476f-9045-4a234200ec42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:50.884350 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-84195a8d-c09b-476f-9045-4a234200ec42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:50.898279 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84195a8d-c09b-476f-9045-4a234200ec42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:50.899940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84195a8d-c09b-476f-9045-4a234200ec42 service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:50.916784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1400/2810] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:20:57.006301 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b0ec-49a8-45b3-958b-fe8e132cb9a6 service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:57.026973 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b0ec-49a8-45b3-958b-fe8e132cb9a6 service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:57.031944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23157c-62b3-4838-879f-c736bfce763a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:57.032579 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23157c-62b3-4838-879f-c736bfce763a service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:57.032865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23157c-62b3-4838-879f-c736bfce763a service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:57.033139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23157c-62b3-4838-879f-c736bfce763a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:57.034919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-2b23157c-62b3-4838-879f-c736bfce763a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:57.058868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23157c-62b3-4838-879f-c736bfce763a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:57.060458 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23157c-62b3-4838-879f-c736bfce763a service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:57.072129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1411/2811] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:20:58.810709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84195a8d-c09b-476f-9045-4a234200ec42 service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:58.869747 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84195a8d-c09b-476f-9045-4a234200ec42 service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:58.873324 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186bf7-41bd-4412-a691-9d02e64835e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:58.874222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186bf7-41bd-4412-a691-9d02e64835e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:58.875186 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186bf7-41bd-4412-a691-9d02e64835e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:58.875470 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186bf7-41bd-4412-a691-9d02e64835e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:58.877313 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4f186bf7-41bd-4412-a691-9d02e64835e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:58.961969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f186bf7-41bd-4412-a691-9d02e64835e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:58.963437 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f186bf7-41bd-4412-a691-9d02e64835e8 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:58.981888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1401/2812] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:20:59.798899 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23157c-62b3-4838-879f-c736bfce763a service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:20:59.816272 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23157c-62b3-4838-879f-c736bfce763a service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:20:59.823917 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01785a-bdab-401f-a11b-1af989805d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:20:59.825029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01785a-bdab-401f-a11b-1af989805d9e service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:20:59.825029 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01785a-bdab-401f-a11b-1af989805d9e service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:20:59.825337 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01785a-bdab-401f-a11b-1af989805d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:20:59.827132 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9d01785a-bdab-401f-a11b-1af989805d9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:20:59.841105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01785a-bdab-401f-a11b-1af989805d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:20:59.842791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01785a-bdab-401f-a11b-1af989805d9e service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:20:59.863022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1412/2813] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:20:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:21:06.369146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186bf7-41bd-4412-a691-9d02e64835e8 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:21:06.370588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4f186bf7-41bd-4412-a691-9d02e64835e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:21:06.381838 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186bf7-41bd-4412-a691-9d02e64835e8 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:21:06.385757 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896de22-7cdd-49b0-b371-0eb05fc60a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:21:06.386399 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896de22-7cdd-49b0-b371-0eb05fc60a33 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:21:06.386685 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896de22-7cdd-49b0-b371-0eb05fc60a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:21:06.386991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896de22-7cdd-49b0-b371-0eb05fc60a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:21:06.396728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896de22-7cdd-49b0-b371-0eb05fc60a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:21:06.398157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896de22-7cdd-49b0-b371-0eb05fc60a33 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:21:06.409028 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1402/2814] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:21:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:21:09.853719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=53 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:11.052066 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01785a-bdab-401f-a11b-1af989805d9e service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:21:11.061658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01785a-bdab-401f-a11b-1af989805d9e service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:21:11.065437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01cb9a-203d-4016-912a-09370efce0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:21:11.066071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01cb9a-203d-4016-912a-09370efce0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:21:11.066350 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01cb9a-203d-4016-912a-09370efce0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:21:11.066623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01cb9a-203d-4016-912a-09370efce0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:21:11.068425 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-da01cb9a-203d-4016-912a-09370efce0f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:21:11.130323 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01cb9a-203d-4016-912a-09370efce0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:21:11.131834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01cb9a-203d-4016-912a-09370efce0f0 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:21:11.142269 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1413/2815] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:21:16.403624 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=85 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:17.482578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896de22-7cdd-49b0-b371-0eb05fc60a33 service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:21:17.484870 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5896de22-7cdd-49b0-b371-0eb05fc60a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:21:17.499961 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896de22-7cdd-49b0-b371-0eb05fc60a33 service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:21:17.504458 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:21:17.505316 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:21:17.505601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:21:17.505876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] PATH_INFO: `/v3/users/06b8d18d37e7467f84841ec6ac0080fb` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:21:17.507141 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b8d18d37e7467f84841ec6ac0080fb)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:21:17.509302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:21:17.558420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b8d18d37e7467f84841ec6ac0080fb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:17.565395 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b8d18d37e7467f84841ec6ac0080fb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:17.566074 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b8d18d37e7467f84841ec6ac0080fb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:17.566671 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b8d18d37e7467f84841ec6ac0080fb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:17.578719 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b8d18d37e7467f84841ec6ac0080fb'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:17.591296 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1403/2816] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:21:17 2022] DELETE /identity/v3/users/06b8d18d37e7467f84841ec6ac0080fb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:21:17.758772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01cb9a-203d-4016-912a-09370efce0f0 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:21:17.770294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01cb9a-203d-4016-912a-09370efce0f0 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:21:17.828957 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:21:17.829738 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:21:17.830022 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:21:17.830298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] PATH_INFO: `/v3/projects/99bc86fccaff473aaa2ee8b35c7a357f` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:21:17.831495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99bc86fccaff473aaa2ee8b35c7a357f)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:21:17.833395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:21:17.878399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99bc86fccaff473aaa2ee8b35c7a357f', 'request_id': 'req-591c4542-89ee-4c29-a069-24094fa220f6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:17.886200 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99bc86fccaff473aaa2ee8b35c7a357f', 'request_id': 'req-591c4542-89ee-4c29-a069-24094fa220f6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:17.892431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99bc86fccaff473aaa2ee8b35c7a357f', 'request_id': 'req-591c4542-89ee-4c29-a069-24094fa220f6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:17.903264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] The token cache is being invalidate because project 99bc86fccaff473aaa2ee8b35c7a357f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:21:17.903551 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:17.904176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:17.906570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1414/2817] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:21:17 2022] DELETE /identity/v3/projects/99bc86fccaff473aaa2ee8b35c7a357f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:21:17.910312 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:21:17.911761 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:21:17.924759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474fab9-a0e3-47e1-b50e-7df4a16877f6 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:21:17.980637 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:21:17.981505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:21:17.981789 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:21:17.982065 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] PATH_INFO: `/v3/users/8b3acef01a3b4084917d3aaaa39f4dca` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:21:17.995548 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3acef01a3b4084917d3aaaa39f4dca)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:21:17.997472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:21:18.047140 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3acef01a3b4084917d3aaaa39f4dca'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:18.053867 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3acef01a3b4084917d3aaaa39f4dca'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:18.054521 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3acef01a3b4084917d3aaaa39f4dca'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:18.055162 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3acef01a3b4084917d3aaaa39f4dca'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:18.060248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:18.069301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-851e00be-c131-4fc0-bf6b-2d44744712cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3acef01a3b4084917d3aaaa39f4dca'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:18.083213 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1404/2818] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:21:17 2022] DELETE /identity/v3/users/8b3acef01a3b4084917d3aaaa39f4dca => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:21:18.259009 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:21:18.260433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:21:18.273759 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4542-89ee-4c29-a069-24094fa220f6 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:21:18.297705 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:18.336453 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:21:18.337236 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:21:18.337515 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:21:18.337786 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] PATH_INFO: `/v3/projects/6d54d0016950455191e6f80880239c42` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:21:18.348148 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d54d0016950455191e6f80880239c42)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:21:18.350044 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:21:18.395713 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d54d0016950455191e6f80880239c42', 'request_id': 'req-083194ac-0688-495a-aa5c-c41596820af2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:18.402677 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d54d0016950455191e6f80880239c42', 'request_id': 'req-083194ac-0688-495a-aa5c-c41596820af2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:18.408866 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d54d0016950455191e6f80880239c42', 'request_id': 'req-083194ac-0688-495a-aa5c-c41596820af2'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:18.420096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] The token cache is being invalidate because project 6d54d0016950455191e6f80880239c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80382) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:21:18.420383 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:18.421523 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:21:18.423221 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1415/2819] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:21:18 2022] DELETE /identity/v3/projects/6d54d0016950455191e6f80880239c42 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:21:28.079564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=6,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:28.417096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:40.247535 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0df7cd-6a98-4d3e-b8a1-eb807f46eb2c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:21:40.247972 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0df7cd-6a98-4d3e-b8a1-eb807f46eb2c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:21:40.248103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0df7cd-6a98-4d3e-b8a1-eb807f46eb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:21:40.266330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ef0df7cd-6a98-4d3e-b8a1-eb807f46eb2c None None] MFA Rules not processed for user `9ce04aa758ca400786dfcc5e13d0cf10`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:21:40.267634 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ef0df7cd-6a98-4d3e-b8a1-eb807f46eb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:21:40.324082 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1405/2820] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:21:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:21:40.633181 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:21:40.634893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:21:40.691419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083194ac-0688-495a-aa5c-c41596820af2 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:21:40.694970 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb56e0b-d3ff-42cb-92ed-2f1474360859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:21:40.695614 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb56e0b-d3ff-42cb-92ed-2f1474360859 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:21:40.695904 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb56e0b-d3ff-42cb-92ed-2f1474360859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:21:40.696187 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb56e0b-d3ff-42cb-92ed-2f1474360859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:21:40.697935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-fcb56e0b-d3ff-42cb-92ed-2f1474360859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:21:40.707868 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb56e0b-d3ff-42cb-92ed-2f1474360859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:21:40.709356 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb56e0b-d3ff-42cb-92ed-2f1474360859 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:21:40.717534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1416/2821] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:21:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:21:50.317115 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=25 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:21:50.713719 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=26 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:08.435176 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0df7cd-6a98-4d3e-b8a1-eb807f46eb2c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:23:08.436620 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ef0df7cd-6a98-4d3e-b8a1-eb807f46eb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:23:08.514291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0df7cd-6a98-4d3e-b8a1-eb807f46eb2c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:23:08.517921 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9ead1-ecbf-4896-8a6c-295e40e326e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:23:08.518570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9ead1-ecbf-4896-8a6c-295e40e326e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:23:08.518887 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9ead1-ecbf-4896-8a6c-295e40e326e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:23:08.519169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9ead1-ecbf-4896-8a6c-295e40e326e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:23:08.521016 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-4ab9ead1-ecbf-4896-8a6c-295e40e326e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:23:08.594691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9ead1-ecbf-4896-8a6c-295e40e326e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:23:08.596097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9ead1-ecbf-4896-8a6c-295e40e326e1 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:23:08.608014 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1406/2822] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:23:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:23:10.003434 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb56e0b-d3ff-42cb-92ed-2f1474360859 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:23:10.014086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb56e0b-d3ff-42cb-92ed-2f1474360859 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:23:10.017693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef01fc0-f9ae-4059-830b-f246977d87be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:23:10.018327 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef01fc0-f9ae-4059-830b-f246977d87be service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:23:10.018613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef01fc0-f9ae-4059-830b-f246977d87be service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:23:10.018929 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef01fc0-f9ae-4059-830b-f246977d87be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:23:10.020669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1ef01fc0-f9ae-4059-830b-f246977d87be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:23:10.033783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef01fc0-f9ae-4059-830b-f246977d87be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:23:10.035255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef01fc0-f9ae-4059-830b-f246977d87be service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:23:10.046550 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1417/2823] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:23:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:23:18.603022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=63 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:19.793705 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430cc71-7f1f-4551-831e-bf3a9bb592ae None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:23:19.794291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430cc71-7f1f-4551-831e-bf3a9bb592ae None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:23:19.794291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430cc71-7f1f-4551-831e-bf3a9bb592ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:23:19.811260 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2430cc71-7f1f-4551-831e-bf3a9bb592ae None None] MFA Rules not processed for user `9ce04aa758ca400786dfcc5e13d0cf10`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:23:19.812527 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2430cc71-7f1f-4551-831e-bf3a9bb592ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:23:19.819931 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1407/2824] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:23:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:23:20.041700 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:20.117660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef01fc0-f9ae-4059-830b-f246977d87be service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:23:20.119099 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-1ef01fc0-f9ae-4059-830b-f246977d87be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:23:20.129647 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef01fc0-f9ae-4059-830b-f246977d87be service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:23:20.133958 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7cb2a-1fc0-4b9a-828f-7277fede3eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:23:20.134883 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7cb2a-1fc0-4b9a-828f-7277fede3eee service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:23:20.135171 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7cb2a-1fc0-4b9a-828f-7277fede3eee service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:23:20.135448 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7cb2a-1fc0-4b9a-828f-7277fede3eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:23:20.137152 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-04e7cb2a-1fc0-4b9a-828f-7277fede3eee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:23:20.146331 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7cb2a-1fc0-4b9a-828f-7277fede3eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:23:20.147801 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7cb2a-1fc0-4b9a-828f-7277fede3eee service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:23:20.155751 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1418/2825] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:23:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:23:29.806405 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:30.152389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:36.340919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430cc71-7f1f-4551-831e-bf3a9bb592ae None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:23:36.351652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430cc71-7f1f-4551-831e-bf3a9bb592ae None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:23:36.355478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd9231-2ed6-47c4-9542-8bd017cc113f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:23:36.356200 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9231-2ed6-47c4-9542-8bd017cc113f service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:23:36.356727 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9231-2ed6-47c4-9542-8bd017cc113f service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:23:36.357070 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9231-2ed6-47c4-9542-8bd017cc113f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:23:36.358939 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-e6dd9231-2ed6-47c4-9542-8bd017cc113f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:23:36.369656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd9231-2ed6-47c4-9542-8bd017cc113f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:23:36.371220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd9231-2ed6-47c4-9542-8bd017cc113f service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:23:36.379582 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1408/2826] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:23:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:23:36.465202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7cb2a-1fc0-4b9a-828f-7277fede3eee service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:23:36.474219 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7cb2a-1fc0-4b9a-828f-7277fede3eee service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:23:36.478473 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806b5fe-043c-483b-90b6-7daae3c53c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:23:36.479147 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806b5fe-043c-483b-90b6-7daae3c53c6b service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:23:36.479427 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806b5fe-043c-483b-90b6-7daae3c53c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:23:36.479698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806b5fe-043c-483b-90b6-7daae3c53c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:23:36.481414 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e806b5fe-043c-483b-90b6-7daae3c53c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:23:36.496880 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806b5fe-043c-483b-90b6-7daae3c53c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:23:36.498567 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806b5fe-043c-483b-90b6-7daae3c53c6b service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:23:36.510428 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1419/2827] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:23:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:23:37.682356 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd9231-2ed6-47c4-9542-8bd017cc113f service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:23:37.690993 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd9231-2ed6-47c4-9542-8bd017cc113f service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:23:37.694659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799da8cd-b9b6-4cd2-8da6-50c5948edcd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:23:37.695328 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799da8cd-b9b6-4cd2-8da6-50c5948edcd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:23:37.695615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799da8cd-b9b6-4cd2-8da6-50c5948edcd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:23:37.695893 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799da8cd-b9b6-4cd2-8da6-50c5948edcd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:23:37.697670 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-799da8cd-b9b6-4cd2-8da6-50c5948edcd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:23:37.707118 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799da8cd-b9b6-4cd2-8da6-50c5948edcd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:23:37.708542 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799da8cd-b9b6-4cd2-8da6-50c5948edcd5 service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:23:37.716539 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1409/2828] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:23:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:23:46.504919 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:23:47.712904 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=12 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:24:37.551364 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806b5fe-043c-483b-90b6-7daae3c53c6b service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:24:37.552845 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e806b5fe-043c-483b-90b6-7daae3c53c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:24:37.567235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806b5fe-043c-483b-90b6-7daae3c53c6b service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:24:37.573373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960b963-b3f2-4fec-9e93-bacb5c18a003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:24:37.574006 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960b963-b3f2-4fec-9e93-bacb5c18a003 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:24:37.574293 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960b963-b3f2-4fec-9e93-bacb5c18a003 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:24:37.574576 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960b963-b3f2-4fec-9e93-bacb5c18a003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:24:37.576342 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d960b963-b3f2-4fec-9e93-bacb5c18a003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:24:37.586437 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960b963-b3f2-4fec-9e93-bacb5c18a003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:24:37.588224 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960b963-b3f2-4fec-9e93-bacb5c18a003 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:24:37.597198 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1420/2829] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:24:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:24:47.593176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:24:53.628858 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d20bf-ef86-4e64-900b-c4dabd9943b9 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:24:53.629358 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d20bf-ef86-4e64-900b-c4dabd9943b9 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:24:53.629489 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d20bf-ef86-4e64-900b-c4dabd9943b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:24:53.647788 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-667d20bf-ef86-4e64-900b-c4dabd9943b9 None None] MFA Rules not processed for user `9ce04aa758ca400786dfcc5e13d0cf10`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:24:53.648988 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-667d20bf-ef86-4e64-900b-c4dabd9943b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:24:53.656691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1410/2830] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:24:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:25:03.642981 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:03.809102 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960b963-b3f2-4fec-9e93-bacb5c18a003 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:25:03.810539 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d960b963-b3f2-4fec-9e93-bacb5c18a003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:25:03.827038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960b963-b3f2-4fec-9e93-bacb5c18a003 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:25:03.832588 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1434e-792a-4368-ab1d-2d86a10a8124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:25:03.833237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1434e-792a-4368-ab1d-2d86a10a8124 service nova] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:25:03.833557 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1434e-792a-4368-ab1d-2d86a10a8124 service nova] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:25:03.833840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1434e-792a-4368-ab1d-2d86a10a8124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:25:03.835636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-65d1434e-792a-4368-ab1d-2d86a10a8124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:25:03.847999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1434e-792a-4368-ab1d-2d86a10a8124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:25:03.849585 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1434e-792a-4368-ab1d-2d86a10a8124 service nova] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:25:03.860891 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1421/2831] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:25:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:25:13.856166 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=6 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:19.261505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d20bf-ef86-4e64-900b-c4dabd9943b9 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:25:19.271310 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d20bf-ef86-4e64-900b-c4dabd9943b9 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:25:19.274852 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa4917-c71f-4474-a228-6cb55816aadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:25:19.275486 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4917-c71f-4474-a228-6cb55816aadd service neutron] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:25:19.275765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4917-c71f-4474-a228-6cb55816aadd service neutron] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:25:19.276039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4917-c71f-4474-a228-6cb55816aadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:25:19.277868 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a7fa4917-c71f-4474-a228-6cb55816aadd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:25:19.338472 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa4917-c71f-4474-a228-6cb55816aadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:25:19.341165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa4917-c71f-4474-a228-6cb55816aadd service neutron] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:25:19.351801 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1411/2832] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:25:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:25:24.263698 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1434e-792a-4368-ab1d-2d86a10a8124 service nova] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:25:24.273175 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1434e-792a-4368-ab1d-2d86a10a8124 service nova] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:25:24.276794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a5838-b499-4fa4-b287-df6a3fec79c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:25:24.277482 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5838-b499-4fa4-b287-df6a3fec79c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:25:24.277716 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5838-b499-4fa4-b287-df6a3fec79c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:25:24.277998 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5838-b499-4fa4-b287-df6a3fec79c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:25:24.279770 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a92a5838-b499-4fa4-b287-df6a3fec79c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:25:24.342838 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a5838-b499-4fa4-b287-df6a3fec79c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:25:24.344407 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a5838-b499-4fa4-b287-df6a3fec79c0 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:25:24.355103 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1422/2833] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:25:27.492511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa4917-c71f-4474-a228-6cb55816aadd service neutron] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:25:27.494093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a7fa4917-c71f-4474-a228-6cb55816aadd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:25:27.581060 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa4917-c71f-4474-a228-6cb55816aadd service neutron] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:25:27.587080 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e85a0-02dd-4a81-b484-288f5d019ee1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:25:27.588431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e85a0-02dd-4a81-b484-288f5d019ee1 service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:25:27.589530 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e85a0-02dd-4a81-b484-288f5d019ee1 service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:25:27.589818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e85a0-02dd-4a81-b484-288f5d019ee1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:25:27.592355 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-1e2e85a0-02dd-4a81-b484-288f5d019ee1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:25:27.605560 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e85a0-02dd-4a81-b484-288f5d019ee1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:25:27.607283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e85a0-02dd-4a81-b484-288f5d019ee1 service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:25:27.618229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1412/2834] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:25:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:25:30.639999 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a5838-b499-4fa4-b287-df6a3fec79c0 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:25:30.641699 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-a92a5838-b499-4fa4-b287-df6a3fec79c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:25:30.654456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a5838-b499-4fa4-b287-df6a3fec79c0 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:25:30.659202 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:25:30.660096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:25:30.660385 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:25:30.660667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] PATH_INFO: `/v3/users/2f8e89084a2344cdb89889d7d5744b8b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:25:30.661939 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8e89084a2344cdb89889d7d5744b8b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:25:30.663885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:25:30.710244 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8e89084a2344cdb89889d7d5744b8b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:30.710932 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8e89084a2344cdb89889d7d5744b8b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:30.717962 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8e89084a2344cdb89889d7d5744b8b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:30.718594 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8e89084a2344cdb89889d7d5744b8b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:30.730313 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8e89084a2344cdb89889d7d5744b8b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:30.743307 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1423/2835] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:25:30 2022] DELETE /identity/v3/users/2f8e89084a2344cdb89889d7d5744b8b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:25:30.916668 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e85a0-02dd-4a81-b484-288f5d019ee1 service placement] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:25:30.928181 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e85a0-02dd-4a81-b484-288f5d019ee1 service placement] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:25:30.986570 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:25:30.987455 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:25:30.987740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:25:30.988018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] PATH_INFO: `/v3/projects/9b4b5edf7a064c2eb276bdf2c418f26e` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:25:30.989243 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4b5edf7a064c2eb276bdf2c418f26e)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:25:30.991184 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:25:31.025466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:31.038784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4b5edf7a064c2eb276bdf2c418f26e', 'request_id': 'req-c5d7276c-4c5e-43b9-8456-18fef42d93ac'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.046888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4b5edf7a064c2eb276bdf2c418f26e', 'request_id': 'req-c5d7276c-4c5e-43b9-8456-18fef42d93ac'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.053119 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4b5edf7a064c2eb276bdf2c418f26e', 'request_id': 'req-c5d7276c-4c5e-43b9-8456-18fef42d93ac'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.064166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] The token cache is being invalidate because project 9b4b5edf7a064c2eb276bdf2c418f26e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:25:31.064449 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.065068 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.066647 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1413/2836] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:25:30 2022] DELETE /identity/v3/projects/9b4b5edf7a064c2eb276bdf2c418f26e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:25:31.070555 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:25:31.071987 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:25:31.085617 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d0091-f38c-49de-b205-c24ed4d768e7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:25:31.141685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:25:31.142554 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:25:31.142876 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:25:31.143157 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] PATH_INFO: `/v3/users/e4dd471c0d894e8b9bb7ab08bfa223d8` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:25:31.144329 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4dd471c0d894e8b9bb7ab08bfa223d8)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:25:31.146260 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:25:31.151686 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:31.197570 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4dd471c0d894e8b9bb7ab08bfa223d8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.198234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4dd471c0d894e8b9bb7ab08bfa223d8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.205506 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4dd471c0d894e8b9bb7ab08bfa223d8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.206177 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4dd471c0d894e8b9bb7ab08bfa223d8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.218659 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4dd471c0d894e8b9bb7ab08bfa223d8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.232010 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1424/2837] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:25:31 2022] DELETE /identity/v3/users/e4dd471c0d894e8b9bb7ab08bfa223d8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:25:31.407424 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:25:31.408877 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:25:31.422508 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7276c-4c5e-43b9-8456-18fef42d93ac admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:25:31.486538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:25:31.487466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:25:31.487749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:25:31.488026 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] PATH_INFO: `/v3/projects/bbfbd281f6bb4bcd8633f4329fdad888` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:25:31.489232 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbfbd281f6bb4bcd8633f4329fdad888)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:25:31.491353 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:25:31.539968 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbfbd281f6bb4bcd8633f4329fdad888', 'request_id': 'req-575b5b71-1f16-4620-b753-13614be9b83c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.547166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbfbd281f6bb4bcd8633f4329fdad888', 'request_id': 'req-575b5b71-1f16-4620-b753-13614be9b83c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.553511 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbfbd281f6bb4bcd8633f4329fdad888', 'request_id': 'req-575b5b71-1f16-4620-b753-13614be9b83c'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.564337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] The token cache is being invalidate because project bbfbd281f6bb4bcd8633f4329fdad888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:25:31.564626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.565264 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:25:31.566830 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1414/2838] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:25:31 2022] DELETE /identity/v3/projects/bbfbd281f6bb4bcd8633f4329fdad888 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:25:41.227978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:25:41.561360 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:00.987257 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:00.988763 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:01.059005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f78029-82a2-4866-99ad-e3a8d08eb981 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:01.119328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73e823-7018-4acd-9c21-8aadee1a9737 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:01.119978 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73e823-7018-4acd-9c21-8aadee1a9737 service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:01.120267 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73e823-7018-4acd-9c21-8aadee1a9737 service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:01.120547 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73e823-7018-4acd-9c21-8aadee1a9737 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:01.122291 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4a73e823-7018-4acd-9c21-8aadee1a9737 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:01.133598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73e823-7018-4acd-9c21-8aadee1a9737 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:01.136199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73e823-7018-4acd-9c21-8aadee1a9737 service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:01.146041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1425/2839] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:26:11.141726 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=58 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:24.470878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:24.473551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:24.567679 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b5b71-1f16-4620-b753-13614be9b83c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:24.573522 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8bee-d1f8-4ff9-aef7-61b914cba5bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9021e2249e11489083139e210562ce44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:24.574784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8bee-d1f8-4ff9-aef7-61b914cba5bc service nova] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:24.574784 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8bee-d1f8-4ff9-aef7-61b914cba5bc service nova] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:24.575093 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8bee-d1f8-4ff9-aef7-61b914cba5bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:24.577188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-eb5d8bee-d1f8-4ff9-aef7-61b914cba5bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:24.590664 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d8bee-d1f8-4ff9-aef7-61b914cba5bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:24.592302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d8bee-d1f8-4ff9-aef7-61b914cba5bc service nova] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:24.603097 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1415/2840] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 18:26:29.657951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73e823-7018-4acd-9c21-8aadee1a9737 service placement] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:29.659398 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-4a73e823-7018-4acd-9c21-8aadee1a9737 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:29.715123 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73e823-7018-4acd-9c21-8aadee1a9737 service placement] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:29.718896 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d12cdc-1ae1-45d7-9b01-bc562fdd9cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:29.719543 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d12cdc-1ae1-45d7-9b01-bc562fdd9cef service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:29.719828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d12cdc-1ae1-45d7-9b01-bc562fdd9cef service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:29.720118 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d12cdc-1ae1-45d7-9b01-bc562fdd9cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:29.721948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-35d12cdc-1ae1-45d7-9b01-bc562fdd9cef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:29.785495 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d12cdc-1ae1-45d7-9b01-bc562fdd9cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:29.786885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d12cdc-1ae1-45d7-9b01-bc562fdd9cef service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:29.796865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1426/2841] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:26:32.546447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8bee-d1f8-4ff9-aef7-61b914cba5bc service nova] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:32.548528 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-eb5d8bee-d1f8-4ff9-aef7-61b914cba5bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:32.563995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8bee-d1f8-4ff9-aef7-61b914cba5bc service nova] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:32.569032 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164fe1-7b79-44e7-81e6-b553d4e3b33a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:32.569754 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164fe1-7b79-44e7-81e6-b553d4e3b33a service placement] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:32.570124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164fe1-7b79-44e7-81e6-b553d4e3b33a service placement] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:32.570468 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164fe1-7b79-44e7-81e6-b553d4e3b33a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:32.572287 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-8b164fe1-7b79-44e7-81e6-b553d4e3b33a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:32.584650 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b164fe1-7b79-44e7-81e6-b553d4e3b33a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:32.586275 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b164fe1-7b79-44e7-81e6-b553d4e3b33a service placement] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:32.601443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d12cdc-1ae1-45d7-9b01-bc562fdd9cef service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:32.603897 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-35d12cdc-1ae1-45d7-9b01-bc562fdd9cef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:32.605411 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1416/2842] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:26:32.621727 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d12cdc-1ae1-45d7-9b01-bc562fdd9cef service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:32.627210 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:32.628164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:32.628513 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:32.628852 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] PATH_INFO: `/v3/users/9ce04aa758ca400786dfcc5e13d0cf10` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:32.630237 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce04aa758ca400786dfcc5e13d0cf10)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:32.632959 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:32.689497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce04aa758ca400786dfcc5e13d0cf10'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:32.690161 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce04aa758ca400786dfcc5e13d0cf10'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:32.697395 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce04aa758ca400786dfcc5e13d0cf10'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:32.698199 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce04aa758ca400786dfcc5e13d0cf10'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:32.714603 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-5eaf57c4-cc60-4650-b1e5-c1a499c59e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce04aa758ca400786dfcc5e13d0cf10'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:32.728420 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1427/2843] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:26:32 2022] DELETE /identity/v3/users/9ce04aa758ca400786dfcc5e13d0cf10 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 18:26:32.904538 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164fe1-7b79-44e7-81e6-b553d4e3b33a service placement] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:32.915103 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164fe1-7b79-44e7-81e6-b553d4e3b33a service placement] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:32.980709 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:32.981479 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:32.981756 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:32.982063 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] PATH_INFO: `/v3/projects/0b2219c143d44ab09672beca155dfaca` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:32.983596 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2219c143d44ab09672beca155dfaca)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:32.985494 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.033833 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2219c143d44ab09672beca155dfaca', 'request_id': 'req-29f357b7-51e4-43df-9f79-e52897d180fd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:33.040878 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2219c143d44ab09672beca155dfaca', 'request_id': 'req-29f357b7-51e4-43df-9f79-e52897d180fd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:33.047133 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2219c143d44ab09672beca155dfaca', 'request_id': 'req-29f357b7-51e4-43df-9f79-e52897d180fd'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:33.058423 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] The token cache is being invalidate because project 0b2219c143d44ab09672beca155dfaca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:26:33.058738 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:33.059372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-29f357b7-51e4-43df-9f79-e52897d180fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:33.061413 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1417/2844] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:26:32 2022] DELETE /identity/v3/projects/0b2219c143d44ab09672beca155dfaca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:33.066341 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ba20c-682e-4c45-a35e-4a628498ffac None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.066637 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ba20c-682e-4c45-a35e-4a628498ffac None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.066951 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ba20c-682e-4c45-a35e-4a628498ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.085037 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-5d5ba20c-682e-4c45-a35e-4a628498ffac None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:33.086234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-5d5ba20c-682e-4c45-a35e-4a628498ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:33.102819 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:33.160280 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1428/2845] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:33.168510 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a81fc-5784-48c9-9589-73adddcb5c20 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.168828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a81fc-5784-48c9-9589-73adddcb5c20 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.169106 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a81fc-5784-48c9-9589-73adddcb5c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.179689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:33.194661 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-be6a81fc-5784-48c9-9589-73adddcb5c20 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:33.195940 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-be6a81fc-5784-48c9-9589-73adddcb5c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:33.203958 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1418/2846] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:33.208188 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ba20c-682e-4c45-a35e-4a628498ffac None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.217947 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ba20c-682e-4c45-a35e-4a628498ffac None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.222814 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938551ad-7283-4609-b485-6788dccc283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.223340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938551ad-7283-4609-b485-6788dccc283b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.223625 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938551ad-7283-4609-b485-6788dccc283b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.223888 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938551ad-7283-4609-b485-6788dccc283b admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.224620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938551ad-7283-4609-b485-6788dccc283b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:26:33.224930 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938551ad-7283-4609-b485-6788dccc283b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.226552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938551ad-7283-4609-b485-6788dccc283b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.239825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1429/2847] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:26:33.244120 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a81fc-5784-48c9-9589-73adddcb5c20 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.254631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a81fc-5784-48c9-9589-73adddcb5c20 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.259206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3c5d-bf56-471f-bc71-c9d545978016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.259876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3c5d-bf56-471f-bc71-c9d545978016 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.260157 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3c5d-bf56-471f-bc71-c9d545978016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.260682 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3c5d-bf56-471f-bc71-c9d545978016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.261529 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe3c5d-bf56-471f-bc71-c9d545978016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.264004 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe3c5d-bf56-471f-bc71-c9d545978016 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.291919 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1419/2848] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:26:33 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:26:33.297153 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938551ad-7283-4609-b485-6788dccc283b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.307146 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938551ad-7283-4609-b485-6788dccc283b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.365609 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494af672-2350-4e70-8f86-52832263fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.366276 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494af672-2350-4e70-8f86-52832263fc6a admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.366562 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494af672-2350-4e70-8f86-52832263fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.366871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494af672-2350-4e70-8f86-52832263fc6a admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.367561 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494af672-2350-4e70-8f86-52832263fc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.369471 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494af672-2350-4e70-8f86-52832263fc6a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.390078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1430/2849] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:26:33 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:26:33.394172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3c5d-bf56-471f-bc71-c9d545978016 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.410372 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3c5d-bf56-471f-bc71-c9d545978016 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.415536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012528c-26bc-4d35-8fab-6275f94e8d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.416188 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012528c-26bc-4d35-8fab-6275f94e8d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.416532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012528c-26bc-4d35-8fab-6275f94e8d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.416809 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012528c-26bc-4d35-8fab-6275f94e8d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.417537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012528c-26bc-4d35-8fab-6275f94e8d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.419220 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012528c-26bc-4d35-8fab-6275f94e8d5a admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.430871 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1420/2850] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:26:33.434772 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494af672-2350-4e70-8f86-52832263fc6a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.445704 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494af672-2350-4e70-8f86-52832263fc6a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.450247 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f960d9b-5097-4c22-8bdf-645d2b7a7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.450980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f960d9b-5097-4c22-8bdf-645d2b7a7468 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.451259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f960d9b-5097-4c22-8bdf-645d2b7a7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.451534 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f960d9b-5097-4c22-8bdf-645d2b7a7468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.452250 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f960d9b-5097-4c22-8bdf-645d2b7a7468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.453834 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f960d9b-5097-4c22-8bdf-645d2b7a7468 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.463882 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1431/2851] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:26:33.468108 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012528c-26bc-4d35-8fab-6275f94e8d5a admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.477946 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012528c-26bc-4d35-8fab-6275f94e8d5a admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.483018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e67ab5-0433-4223-937e-379a19531eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.483954 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e67ab5-0433-4223-937e-379a19531eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.484240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e67ab5-0433-4223-937e-379a19531eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.484515 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e67ab5-0433-4223-937e-379a19531eb1 admin admin] PATH_INFO: `/v3/projects/132fad047a9c4c75852ea63e8f17162c/users/bc81250d4cfa48c5bf0fc878ea89366b/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.500309 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e67ab5-0433-4223-937e-379a19531eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132fad047a9c4c75852ea63e8f17162c, user_id=bc81250d4cfa48c5bf0fc878ea89366b, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.503177 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e67ab5-0433-4223-937e-379a19531eb1 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.526557 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1421/2852] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:26:33 2022] PUT /identity/v3/projects/132fad047a9c4c75852ea63e8f17162c/users/bc81250d4cfa48c5bf0fc878ea89366b/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:33.537019 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5ff41-c93e-4661-9c8c-044082c5f12e None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.537387 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5ff41-c93e-4661-9c8c-044082c5f12e None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.537737 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5ff41-c93e-4661-9c8c-044082c5f12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.567255 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-66b5ff41-c93e-4661-9c8c-044082c5f12e None None] MFA Rules not processed for user `bc81250d4cfa48c5bf0fc878ea89366b`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:33.568461 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-66b5ff41-c93e-4661-9c8c-044082c5f12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:33.634232 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1432/2853] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:33.639165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e67ab5-0433-4223-937e-379a19531eb1 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.703291 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e67ab5-0433-4223-937e-379a19531eb1 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.709250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a810c6-b7e7-42e0-b6d8-e73508a81a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.709924 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a810c6-b7e7-42e0-b6d8-e73508a81a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.710205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a810c6-b7e7-42e0-b6d8-e73508a81a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.710478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a810c6-b7e7-42e0-b6d8-e73508a81a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.711205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a810c6-b7e7-42e0-b6d8-e73508a81a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.713092 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a810c6-b7e7-42e0-b6d8-e73508a81a88 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.740770 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1422/2854] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:26:33 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:26:33.745012 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5ff41-c93e-4661-9c8c-044082c5f12e None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.755953 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5ff41-c93e-4661-9c8c-044082c5f12e None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.768556 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:33.812914 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a735fb-cede-4fb7-a6b9-0b39dd6ee4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.813577 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a735fb-cede-4fb7-a6b9-0b39dd6ee4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.813864 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a735fb-cede-4fb7-a6b9-0b39dd6ee4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.814144 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a735fb-cede-4fb7-a6b9-0b39dd6ee4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.814858 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a735fb-cede-4fb7-a6b9-0b39dd6ee4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.816799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a735fb-cede-4fb7-a6b9-0b39dd6ee4a9 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.837034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1433/2855] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:26:33 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:26:33.841323 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a810c6-b7e7-42e0-b6d8-e73508a81a88 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.852406 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a810c6-b7e7-42e0-b6d8-e73508a81a88 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.857078 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d1f4-1c53-4623-9ba8-5ebe77a5aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.858251 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d1f4-1c53-4623-9ba8-5ebe77a5aad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.858536 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d1f4-1c53-4623-9ba8-5ebe77a5aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.858854 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0d1f4-1c53-4623-9ba8-5ebe77a5aad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.859578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d1f4-1c53-4623-9ba8-5ebe77a5aad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.861190 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0d1f4-1c53-4623-9ba8-5ebe77a5aad5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.871751 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1423/2856] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:26:33.875782 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a735fb-cede-4fb7-a6b9-0b39dd6ee4a9 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.885823 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a735fb-cede-4fb7-a6b9-0b39dd6ee4a9 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.891045 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb82a34-948b-4cab-b74f-991ced62ee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.891918 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb82a34-948b-4cab-b74f-991ced62ee48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.892203 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb82a34-948b-4cab-b74f-991ced62ee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.892480 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb82a34-948b-4cab-b74f-991ced62ee48 admin admin] PATH_INFO: `/v3/projects/b28a20756df7443c9191de7acca5f28b/users/be789d24e3654ad394b364ad795946c3/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.907627 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb82a34-948b-4cab-b74f-991ced62ee48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28a20756df7443c9191de7acca5f28b, user_id=be789d24e3654ad394b364ad795946c3, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.910284 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb82a34-948b-4cab-b74f-991ced62ee48 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:33.923456 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1434/2857] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:26:33 2022] PUT /identity/v3/projects/b28a20756df7443c9191de7acca5f28b/users/be789d24e3654ad394b364ad795946c3/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:33.927300 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d1f4-1c53-4623-9ba8-5ebe77a5aad5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:33.937294 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0d1f4-1c53-4623-9ba8-5ebe77a5aad5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:33.993922 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c825c-c810-4dbc-b979-79fb7c9e71ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:33.994505 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c825c-c810-4dbc-b979-79fb7c9e71ad admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:33.994819 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c825c-c810-4dbc-b979-79fb7c9e71ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:33.995126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c825c-c810-4dbc-b979-79fb7c9e71ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:33.996260 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c825c-c810-4dbc-b979-79fb7c9e71ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:33.999440 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c825c-c810-4dbc-b979-79fb7c9e71ad admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:34.010033 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1424/2858] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:26:34.015000 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb82a34-948b-4cab-b74f-991ced62ee48 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:34.025431 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb82a34-948b-4cab-b74f-991ced62ee48 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:34.030245 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454b19a-5f2d-4e8a-8d01-6b0ed4045a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:34.031207 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b19a-5f2d-4e8a-8d01-6b0ed4045a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:34.031491 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b19a-5f2d-4e8a-8d01-6b0ed4045a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:34.031769 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b19a-5f2d-4e8a-8d01-6b0ed4045a5d admin admin] PATH_INFO: `/v3/projects/b28a20756df7443c9191de7acca5f28b/users/be789d24e3654ad394b364ad795946c3/roles/af8084c48e3c40298e26d44d6d14595a` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:34.033783 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454b19a-5f2d-4e8a-8d01-6b0ed4045a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28a20756df7443c9191de7acca5f28b, user_id=be789d24e3654ad394b364ad795946c3, role_id=af8084c48e3c40298e26d44d6d14595a)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:34.036497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454b19a-5f2d-4e8a-8d01-6b0ed4045a5d admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:34.047308 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1435/2859] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:26:34 2022] PUT /identity/v3/projects/b28a20756df7443c9191de7acca5f28b/users/be789d24e3654ad394b364ad795946c3/roles/af8084c48e3c40298e26d44d6d14595a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:34.057270 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2775917-ab37-4989-a879-75ef0906d9ce None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:34.057567 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2775917-ab37-4989-a879-75ef0906d9ce None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:34.057853 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2775917-ab37-4989-a879-75ef0906d9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:34.076412 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:34.086147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f2775917-ab37-4989-a879-75ef0906d9ce None None] MFA Rules not processed for user `be789d24e3654ad394b364ad795946c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:34.087384 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f2775917-ab37-4989-a879-75ef0906d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:34.155659 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1425/2860] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:34.166658 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454b19a-5f2d-4e8a-8d01-6b0ed4045a5d admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:34.168404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e454b19a-5f2d-4e8a-8d01-6b0ed4045a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:34.227072 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454b19a-5f2d-4e8a-8d01-6b0ed4045a5d admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:34.230636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa794b14-89f0-44d8-91f8-5616e32d8273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:34.231294 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794b14-89f0-44d8-91f8-5616e32d8273 service cinder] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:34.231578 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794b14-89f0-44d8-91f8-5616e32d8273 service cinder] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:34.231851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794b14-89f0-44d8-91f8-5616e32d8273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:34.241668 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa794b14-89f0-44d8-91f8-5616e32d8273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:34.243193 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa794b14-89f0-44d8-91f8-5616e32d8273 service cinder] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:34.253825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1436/2861] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:26:34.298959 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2775917-ab37-4989-a879-75ef0906d9ce None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:34.300373 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f2775917-ab37-4989-a879-75ef0906d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:34.312404 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2775917-ab37-4989-a879-75ef0906d9ce None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:34.316023 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90096d-0d10-418f-9bed-40bb6f61119d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:34.316663 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90096d-0d10-418f-9bed-40bb6f61119d service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:34.316948 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90096d-0d10-418f-9bed-40bb6f61119d service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:34.317225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90096d-0d10-418f-9bed-40bb6f61119d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:34.373930 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90096d-0d10-418f-9bed-40bb6f61119d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:34.375449 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90096d-0d10-418f-9bed-40bb6f61119d service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:34.384317 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1426/2862] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:26:37.668885 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa794b14-89f0-44d8-91f8-5616e32d8273 service cinder] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:37.729156 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa794b14-89f0-44d8-91f8-5616e32d8273 service cinder] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:37.734239 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:37.735122 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:37.735401 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:37.735670 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] PATH_INFO: `/v3/users/bc81250d4cfa48c5bf0fc878ea89366b` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:37.736826 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc81250d4cfa48c5bf0fc878ea89366b)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:37.738757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:37.752372 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:37.785141 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc81250d4cfa48c5bf0fc878ea89366b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:37.785777 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc81250d4cfa48c5bf0fc878ea89366b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:37.792648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc81250d4cfa48c5bf0fc878ea89366b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:37.793264 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc81250d4cfa48c5bf0fc878ea89366b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:37.805232 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc81250d4cfa48c5bf0fc878ea89366b'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:37.818038 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1437/2863] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:26:37 2022] DELETE /identity/v3/users/bc81250d4cfa48c5bf0fc878ea89366b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:37.822478 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf82a-963f-44f9-8e06-5b6d0f55e7c1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:37.822987 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf82a-963f-44f9-8e06-5b6d0f55e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:37.823099 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf82a-963f-44f9-8e06-5b6d0f55e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:37.839614 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-234bf82a-963f-44f9-8e06-5b6d0f55e7c1 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:37.840797 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-234bf82a-963f-44f9-8e06-5b6d0f55e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:37.898337 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1427/2864] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:37.908205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:37.909615 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:37.966718 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b8f5-3cc5-4d79-b4f6-f645734890c5 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:37.970361 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ecc8-9871-4f33-8ac8-ddda2059de23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:37.971034 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ecc8-9871-4f33-8ac8-ddda2059de23 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:37.971322 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ecc8-9871-4f33-8ac8-ddda2059de23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:37.971599 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ecc8-9871-4f33-8ac8-ddda2059de23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:37.980519 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ecc8-9871-4f33-8ac8-ddda2059de23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:37.982443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ecc8-9871-4f33-8ac8-ddda2059de23 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:37.992096 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1438/2865] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:26:38.257900 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bf82a-963f-44f9-8e06-5b6d0f55e7c1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:38.259361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-234bf82a-963f-44f9-8e06-5b6d0f55e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:38.274259 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bf82a-963f-44f9-8e06-5b6d0f55e7c1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:38.278815 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:38.281431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:38.281720 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:38.281997 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] PATH_INFO: `/v3/projects/132fad047a9c4c75852ea63e8f17162c` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:38.283225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=132fad047a9c4c75852ea63e8f17162c)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:38.285126 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:38.317865 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:38.334361 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132fad047a9c4c75852ea63e8f17162c', 'request_id': 'req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.342516 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132fad047a9c4c75852ea63e8f17162c', 'request_id': 'req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.349175 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132fad047a9c4c75852ea63e8f17162c', 'request_id': 'req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.359952 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] The token cache is being invalidate because project 132fad047a9c4c75852ea63e8f17162c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:26:38.360240 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.360875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.362407 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1428/2866] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:26:38 2022] DELETE /identity/v3/projects/132fad047a9c4c75852ea63e8f17162c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:38.366340 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ecc8-9871-4f33-8ac8-ddda2059de23 service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:38.375921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ecc8-9871-4f33-8ac8-ddda2059de23 service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:38.430944 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:38.431982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:38.432275 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:38.432549 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] PATH_INFO: `/v3/users/be789d24e3654ad394b364ad795946c3` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:38.433850 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be789d24e3654ad394b364ad795946c3)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:38.435871 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:38.473666 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:38.483598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be789d24e3654ad394b364ad795946c3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.484235 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be789d24e3654ad394b364ad795946c3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.490879 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be789d24e3654ad394b364ad795946c3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.491497 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be789d24e3654ad394b364ad795946c3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.503121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-2f72f7ca-f29c-4845-ad98-4e330654d4e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be789d24e3654ad394b364ad795946c3'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.517870 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1439/2867] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:26:38 2022] DELETE /identity/v3/users/be789d24e3654ad394b364ad795946c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:38.793772 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:38.795497 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:38.808648 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f21ecf-44e9-45fe-94e7-1e62b61ec1f3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:38.874645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:38.875520 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:38.875798 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:38.876079 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] PATH_INFO: `/v3/projects/b28a20756df7443c9191de7acca5f28b` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:38.877244 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28a20756df7443c9191de7acca5f28b)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:38.879166 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:38.924034 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28a20756df7443c9191de7acca5f28b', 'request_id': 'req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.930866 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28a20756df7443c9191de7acca5f28b', 'request_id': 'req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.937840 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28a20756df7443c9191de7acca5f28b', 'request_id': 'req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.947950 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] The token cache is being invalidate because project b28a20756df7443c9191de7acca5f28b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:26:38.948234 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.948862 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-8a239028-3b18-4ac9-bd55-a7ce5b074bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:38.950377 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1429/2868] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:26:38 2022] DELETE /identity/v3/projects/b28a20756df7443c9191de7acca5f28b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:38.957070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725542-cf75-4b1f-b9e5-ef6ff8d16bcd None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:38.957540 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725542-cf75-4b1f-b9e5-ef6ff8d16bcd None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:38.957661 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725542-cf75-4b1f-b9e5-ef6ff8d16bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:38.974935 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-d9725542-cf75-4b1f-b9e5-ef6ff8d16bcd None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:38.976061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-d9725542-cf75-4b1f-b9e5-ef6ff8d16bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:39.034623 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1440/2869] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:39.042315 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba32a4a-61fa-4ac2-8263-fa1f981ac32c None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:39.042603 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba32a4a-61fa-4ac2-8263-fa1f981ac32c None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:39.042902 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba32a4a-61fa-4ac2-8263-fa1f981ac32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:39.061569 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-5ba32a4a-61fa-4ac2-8263-fa1f981ac32c None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:39.062800 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-5ba32a4a-61fa-4ac2-8263-fa1f981ac32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:39.070631 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1430/2870] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:39.074598 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725542-cf75-4b1f-b9e5-ef6ff8d16bcd None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:39.084893 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725542-cf75-4b1f-b9e5-ef6ff8d16bcd None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:39.089483 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2c79f-ea30-40a3-b6ec-5b64fa8e1e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:39.090133 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c79f-ea30-40a3-b6ec-5b64fa8e1e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:39.090417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c79f-ea30-40a3-b6ec-5b64fa8e1e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:39.090693 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c79f-ea30-40a3-b6ec-5b64fa8e1e0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:39.091477 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2c79f-ea30-40a3-b6ec-5b64fa8e1e0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:26:39.091791 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2c79f-ea30-40a3-b6ec-5b64fa8e1e0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:39.093387 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2c79f-ea30-40a3-b6ec-5b64fa8e1e0a admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:39.105817 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1441/2871] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:26:39.110389 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba32a4a-61fa-4ac2-8263-fa1f981ac32c None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:39.120040 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba32a4a-61fa-4ac2-8263-fa1f981ac32c None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:39.125341 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfb48d-bba8-4c1b-a5ba-642395bbffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:39.125991 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfb48d-bba8-4c1b-a5ba-642395bbffb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:39.126302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfb48d-bba8-4c1b-a5ba-642395bbffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:39.126578 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfb48d-bba8-4c1b-a5ba-642395bbffb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:39.127301 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfb48d-bba8-4c1b-a5ba-642395bbffb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:39.129183 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfb48d-bba8-4c1b-a5ba-642395bbffb4 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:39.157635 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1431/2872] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:26:39 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:26:39.158811 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2c79f-ea30-40a3-b6ec-5b64fa8e1e0a admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:39.168742 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2c79f-ea30-40a3-b6ec-5b64fa8e1e0a admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:39.230443 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b048-7ad6-4f41-8797-d98195c08486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:39.231071 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b048-7ad6-4f41-8797-d98195c08486 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:39.231354 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b048-7ad6-4f41-8797-d98195c08486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:39.231628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b048-7ad6-4f41-8797-d98195c08486 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:39.233449 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50b048-7ad6-4f41-8797-d98195c08486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:39.235464 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50b048-7ad6-4f41-8797-d98195c08486 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:39.255722 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1442/2873] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:26:39 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 18:26:39.259779 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfb48d-bba8-4c1b-a5ba-642395bbffb4 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:39.270584 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfb48d-bba8-4c1b-a5ba-642395bbffb4 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:39.275267 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d63ff6-3cc5-4629-9400-eb54c9c9b9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:39.275925 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d63ff6-3cc5-4629-9400-eb54c9c9b9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:39.276208 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d63ff6-3cc5-4629-9400-eb54c9c9b9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:39.276487 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d63ff6-3cc5-4629-9400-eb54c9c9b9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:39.277204 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d63ff6-3cc5-4629-9400-eb54c9c9b9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:39.278818 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d63ff6-3cc5-4629-9400-eb54c9c9b9f5 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:39.289326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1432/2874] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:26:39.293290 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b048-7ad6-4f41-8797-d98195c08486 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:39.303907 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b048-7ad6-4f41-8797-d98195c08486 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:39.308400 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58931bb2-350b-49a9-b0d5-80f631cfcc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:39.309048 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58931bb2-350b-49a9-b0d5-80f631cfcc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:39.309328 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58931bb2-350b-49a9-b0d5-80f631cfcc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:39.309601 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58931bb2-350b-49a9-b0d5-80f631cfcc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:39.311370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58931bb2-350b-49a9-b0d5-80f631cfcc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:39.312982 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58931bb2-350b-49a9-b0d5-80f631cfcc6b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:39.322646 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1443/2875] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:26:39.326551 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d63ff6-3cc5-4629-9400-eb54c9c9b9f5 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:39.336432 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d63ff6-3cc5-4629-9400-eb54c9c9b9f5 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:39.341017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c7324-e00a-48a6-a5c3-7329e73265c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:39.341995 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7324-e00a-48a6-a5c3-7329e73265c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:39.342281 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7324-e00a-48a6-a5c3-7329e73265c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:39.342558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7324-e00a-48a6-a5c3-7329e73265c3 admin admin] PATH_INFO: `/v3/projects/61ada593c4bf433eb1c5c22cffa3a364/users/29bb3dd3a44141f39281bfc58444a386/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:39.344828 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:39.360381 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c7324-e00a-48a6-a5c3-7329e73265c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ada593c4bf433eb1c5c22cffa3a364, user_id=29bb3dd3a44141f39281bfc58444a386, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:39.363073 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c7324-e00a-48a6-a5c3-7329e73265c3 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:39.376018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1433/2876] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:26:39 2022] PUT /identity/v3/projects/61ada593c4bf433eb1c5c22cffa3a364/users/29bb3dd3a44141f39281bfc58444a386/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:39.386389 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0847df-2152-4896-9214-ead9f6c4b6fb None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:39.386679 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0847df-2152-4896-9214-ead9f6c4b6fb None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:39.386984 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0847df-2152-4896-9214-ead9f6c4b6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:39.412764 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-8b0847df-2152-4896-9214-ead9f6c4b6fb None None] MFA Rules not processed for user `29bb3dd3a44141f39281bfc58444a386`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:39.413988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-8b0847df-2152-4896-9214-ead9f6c4b6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:39.422620 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:39.481334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1444/2877] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:39.492393 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c7324-e00a-48a6-a5c3-7329e73265c3 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:39.494069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3a9c7324-e00a-48a6-a5c3-7329e73265c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:39.551829 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c7324-e00a-48a6-a5c3-7329e73265c3 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:39.555450 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccb797-cef9-45ea-80de-5a62f82fb6ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:39.556086 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb797-cef9-45ea-80de-5a62f82fb6ec service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:39.556369 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb797-cef9-45ea-80de-5a62f82fb6ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:39.556645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb797-cef9-45ea-80de-5a62f82fb6ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:39.564957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccb797-cef9-45ea-80de-5a62f82fb6ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:39.566375 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccb797-cef9-45ea-80de-5a62f82fb6ec service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:39.575022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1434/2878] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:26:42.562262 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0847df-2152-4896-9214-ead9f6c4b6fb None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:42.624215 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0847df-2152-4896-9214-ead9f6c4b6fb None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:42.628836 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:42.629794 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:42.630081 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:42.630358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] PATH_INFO: `/v3/users/29bb3dd3a44141f39281bfc58444a386` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:42.631591 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bb3dd3a44141f39281bfc58444a386)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:42.633527 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:42.680205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bb3dd3a44141f39281bfc58444a386'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:42.680840 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bb3dd3a44141f39281bfc58444a386'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:42.687648 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bb3dd3a44141f39281bfc58444a386'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:42.688261 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bb3dd3a44141f39281bfc58444a386'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:42.699696 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bb3dd3a44141f39281bfc58444a386'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:42.711989 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1445/2879] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:26:42 2022] DELETE /identity/v3/users/29bb3dd3a44141f39281bfc58444a386 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:42.717069 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6276520-c1fc-4472-88fb-686841456775 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:42.717588 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6276520-c1fc-4472-88fb-686841456775 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:42.717765 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6276520-c1fc-4472-88fb-686841456775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:42.734564 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-a6276520-c1fc-4472-88fb-686841456775 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:42.735782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a6276520-c1fc-4472-88fb-686841456775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:42.796390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1435/2880] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:42.815728 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:42.817565 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:42.854455 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:42.882121 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b71b-2be8-4864-a1a4-14c26aa11f6f admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:42.885980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15a40b-ade0-4b0a-8bf2-661ea56fd1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:42.886628 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15a40b-ade0-4b0a-8bf2-661ea56fd1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:42.886948 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15a40b-ade0-4b0a-8bf2-661ea56fd1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:42.887223 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15a40b-ade0-4b0a-8bf2-661ea56fd1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:42.896685 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15a40b-ade0-4b0a-8bf2-661ea56fd1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:42.898120 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15a40b-ade0-4b0a-8bf2-661ea56fd1e7 service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:42.907527 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1446/2881] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:26:43.185611 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6276520-c1fc-4472-88fb-686841456775 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:43.191615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-a6276520-c1fc-4472-88fb-686841456775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:43.209018 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6276520-c1fc-4472-88fb-686841456775 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:43.215222 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:43.217331 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.217843 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.218352 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] PATH_INFO: `/v3/projects/61ada593c4bf433eb1c5c22cffa3a364` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.220475 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ada593c4bf433eb1c5c22cffa3a364)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:43.224277 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:43.275363 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ada593c4bf433eb1c5c22cffa3a364', 'request_id': 'req-3d651991-3440-4ed2-bd21-576d4505128f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:43.283554 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ada593c4bf433eb1c5c22cffa3a364', 'request_id': 'req-3d651991-3440-4ed2-bd21-576d4505128f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:43.289808 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ada593c4bf433eb1c5c22cffa3a364', 'request_id': 'req-3d651991-3440-4ed2-bd21-576d4505128f'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:43.300977 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] The token cache is being invalidate because project 61ada593c4bf433eb1c5c22cffa3a364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:26:43.301210 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:43.301844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-3d651991-3440-4ed2-bd21-576d4505128f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:43.303420 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1436/2882] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:26:43 2022] DELETE /identity/v3/projects/61ada593c4bf433eb1c5c22cffa3a364 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:43.309052 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc11a1b-87dc-411d-a435-0dfb44151de5 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.309343 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc11a1b-87dc-411d-a435-0dfb44151de5 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.309618 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc11a1b-87dc-411d-a435-0dfb44151de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.327078 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-9fc11a1b-87dc-411d-a435-0dfb44151de5 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:43.328283 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-9fc11a1b-87dc-411d-a435-0dfb44151de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:43.389552 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1447/2883] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:43.398225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82717bd-e9ec-4662-a5c9-4b568c5e2dd7 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.398517 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82717bd-e9ec-4662-a5c9-4b568c5e2dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.398856 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82717bd-e9ec-4662-a5c9-4b568c5e2dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.421248 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-f82717bd-e9ec-4662-a5c9-4b568c5e2dd7 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:43.422466 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-f82717bd-e9ec-4662-a5c9-4b568c5e2dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:43.430602 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1437/2884] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:43.435835 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc11a1b-87dc-411d-a435-0dfb44151de5 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:43.450145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc11a1b-87dc-411d-a435-0dfb44151de5 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:43.456636 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058c0c7-748f-4a8b-a692-8fb0e095e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:43.457593 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058c0c7-748f-4a8b-a692-8fb0e095e9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.458018 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058c0c7-748f-4a8b-a692-8fb0e095e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.458426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058c0c7-748f-4a8b-a692-8fb0e095e9d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.459790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058c0c7-748f-4a8b-a692-8fb0e095e9d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:26:43.460319 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058c0c7-748f-4a8b-a692-8fb0e095e9d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:43.463231 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058c0c7-748f-4a8b-a692-8fb0e095e9d7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:43.479712 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1448/2885] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:26:43.484532 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82717bd-e9ec-4662-a5c9-4b568c5e2dd7 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:43.488969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:43.495229 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82717bd-e9ec-4662-a5c9-4b568c5e2dd7 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:43.500782 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335e38a-cb29-4ae2-a341-186759db4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:43.501431 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335e38a-cb29-4ae2-a341-186759db4eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.501714 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335e38a-cb29-4ae2-a341-186759db4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.502022 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335e38a-cb29-4ae2-a341-186759db4eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.502728 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335e38a-cb29-4ae2-a341-186759db4eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:43.504627 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335e38a-cb29-4ae2-a341-186759db4eeb admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:43.531970 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1438/2886] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:26:43 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:26:43.535980 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058c0c7-748f-4a8b-a692-8fb0e095e9d7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:43.546530 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058c0c7-748f-4a8b-a692-8fb0e095e9d7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:43.601036 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3301eaa-0b91-4729-a425-f1f39a3579b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:43.601640 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3301eaa-0b91-4729-a425-f1f39a3579b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.601892 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3301eaa-0b91-4729-a425-f1f39a3579b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.602168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3301eaa-0b91-4729-a425-f1f39a3579b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.602873 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3301eaa-0b91-4729-a425-f1f39a3579b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:43.604769 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3301eaa-0b91-4729-a425-f1f39a3579b4 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:43.626061 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1449/2887] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:26:43 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:26:43.630056 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335e38a-cb29-4ae2-a341-186759db4eeb admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:43.641036 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335e38a-cb29-4ae2-a341-186759db4eeb admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:43.645879 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12c9b-54ca-46a1-a1bd-12a1c7cc6b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:43.646537 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12c9b-54ca-46a1-a1bd-12a1c7cc6b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.646886 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12c9b-54ca-46a1-a1bd-12a1c7cc6b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.647172 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12c9b-54ca-46a1-a1bd-12a1c7cc6b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.647899 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac12c9b-54ca-46a1-a1bd-12a1c7cc6b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:43.649493 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac12c9b-54ca-46a1-a1bd-12a1c7cc6b23 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:43.661512 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1439/2888] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:26:43.665416 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3301eaa-0b91-4729-a425-f1f39a3579b4 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:43.675391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3301eaa-0b91-4729-a425-f1f39a3579b4 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:43.679928 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484061-eeee-4e9f-9528-7bb32d0bd9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:43.680575 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484061-eeee-4e9f-9528-7bb32d0bd9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.680862 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484061-eeee-4e9f-9528-7bb32d0bd9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.681139 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484061-eeee-4e9f-9528-7bb32d0bd9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.681855 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75484061-eeee-4e9f-9528-7bb32d0bd9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:43.683486 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75484061-eeee-4e9f-9528-7bb32d0bd9cf admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:43.693358 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1450/2889] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:26:43.697219 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12c9b-54ca-46a1-a1bd-12a1c7cc6b23 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:43.707541 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12c9b-54ca-46a1-a1bd-12a1c7cc6b23 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:43.712149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0a3dd-0385-450b-ac4d-3ffb50b3f66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:43.713017 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0a3dd-0385-450b-ac4d-3ffb50b3f66c admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.713299 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0a3dd-0385-450b-ac4d-3ffb50b3f66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.713575 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0a3dd-0385-450b-ac4d-3ffb50b3f66c admin admin] PATH_INFO: `/v3/projects/0e003016293844efa3c2c974f045120c/users/3fee90ae8ba2469a9b764c0110d457b6/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.728283 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0a3dd-0385-450b-ac4d-3ffb50b3f66c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e003016293844efa3c2c974f045120c, user_id=3fee90ae8ba2469a9b764c0110d457b6, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:43.730942 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0a3dd-0385-450b-ac4d-3ffb50b3f66c admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:43.748845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1440/2890] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:26:43 2022] PUT /identity/v3/projects/0e003016293844efa3c2c974f045120c/users/3fee90ae8ba2469a9b764c0110d457b6/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:43.761222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051257-01d7-42b4-a1f0-7e45d1c577cc None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.761775 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051257-01d7-42b4-a1f0-7e45d1c577cc None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.762288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051257-01d7-42b4-a1f0-7e45d1c577cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.789825 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-e2051257-01d7-42b4-a1f0-7e45d1c577cc None None] MFA Rules not processed for user `3fee90ae8ba2469a9b764c0110d457b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:43.791070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-e2051257-01d7-42b4-a1f0-7e45d1c577cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:43.816558 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:43.856334 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1451/2891] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:43.866749 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0a3dd-0385-450b-ac4d-3ffb50b3f66c admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:43.868447 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-3fd0a3dd-0385-450b-ac4d-3ffb50b3f66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:43.925302 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0a3dd-0385-450b-ac4d-3ffb50b3f66c admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:43.928964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91fa46-34dd-4774-976d-bc8b4b1e1bb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:43.929601 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fa46-34dd-4774-976d-bc8b4b1e1bb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:43.929888 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fa46-34dd-4774-976d-bc8b4b1e1bb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:43.930165 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fa46-34dd-4774-976d-bc8b4b1e1bb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:43.938430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91fa46-34dd-4774-976d-bc8b4b1e1bb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:43.939889 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91fa46-34dd-4774-976d-bc8b4b1e1bb2 service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:43.948556 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1441/2892] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:26:53.853417 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=15 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:53.944572 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:54.030898 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051257-01d7-42b4-a1f0-7e45d1c577cc None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:54.091370 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051257-01d7-42b4-a1f0-7e45d1c577cc None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:54.095851 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:54.096709 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:54.096988 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:54.097259 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] PATH_INFO: `/v3/users/3fee90ae8ba2469a9b764c0110d457b6` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:54.098415 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fee90ae8ba2469a9b764c0110d457b6)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:54.100357 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:54.145234 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fee90ae8ba2469a9b764c0110d457b6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:54.145867 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fee90ae8ba2469a9b764c0110d457b6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:54.152537 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fee90ae8ba2469a9b764c0110d457b6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:54.153163 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fee90ae8ba2469a9b764c0110d457b6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:54.164795 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fee90ae8ba2469a9b764c0110d457b6'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:54.177874 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1452/2893] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:26:54 2022] DELETE /identity/v3/users/3fee90ae8ba2469a9b764c0110d457b6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:54.182340 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e681-2e3e-471b-9a0c-e387c6b7d3b1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:54.182632 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e681-2e3e-471b-9a0c-e387c6b7d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:54.182964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e681-2e3e-471b-9a0c-e387c6b7d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:54.199504 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-c5d4e681-2e3e-471b-9a0c-e387c6b7d3b1 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:54.200691 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c5d4e681-2e3e-471b-9a0c-e387c6b7d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:54.260673 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1442/2894] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:54.271249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:54.272660 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:54.330568 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2caabf-d522-4022-ac73-4461ef252e6b admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:54.334191 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e1922-be2e-4a99-b148-69dd3b56bf2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:54.334865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e1922-be2e-4a99-b148-69dd3b56bf2a service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:54.335149 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e1922-be2e-4a99-b148-69dd3b56bf2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:54.335422 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e1922-be2e-4a99-b148-69dd3b56bf2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:54.345005 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e1922-be2e-4a99-b148-69dd3b56bf2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:54.346433 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e1922-be2e-4a99-b148-69dd3b56bf2a service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:54.355650 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1453/2895] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:26:54.626039 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e681-2e3e-471b-9a0c-e387c6b7d3b1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:54.627571 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-c5d4e681-2e3e-471b-9a0c-e387c6b7d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:54.640491 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e681-2e3e-471b-9a0c-e387c6b7d3b1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:54.645169 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:54.646656 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:54.647146 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:54.647433 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] PATH_INFO: `/v3/projects/0e003016293844efa3c2c974f045120c` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:54.648626 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e003016293844efa3c2c974f045120c)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:54.650558 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:54.698390 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e003016293844efa3c2c974f045120c', 'request_id': 'req-0c6053d2-2355-46f3-99c9-497810cb6936'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:54.705689 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e003016293844efa3c2c974f045120c', 'request_id': 'req-0c6053d2-2355-46f3-99c9-497810cb6936'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:54.711929 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e003016293844efa3c2c974f045120c', 'request_id': 'req-0c6053d2-2355-46f3-99c9-497810cb6936'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:54.722813 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] The token cache is being invalidate because project 0e003016293844efa3c2c974f045120c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:26:54.723124 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:54.723759 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-0c6053d2-2355-46f3-99c9-497810cb6936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:26:54.725293 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1443/2896] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:26:54 2022] DELETE /identity/v3/projects/0e003016293844efa3c2c974f045120c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:54.730117 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9fc10-26ce-4990-9d80-1813c1c2e5cf None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:54.730404 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9fc10-26ce-4990-9d80-1813c1c2e5cf None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:54.730676 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9fc10-26ce-4990-9d80-1813c1c2e5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:54.748921 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-41c9fc10-26ce-4990-9d80-1813c1c2e5cf None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:54.750105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-41c9fc10-26ce-4990-9d80-1813c1c2e5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:54.767027 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:54.811667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1454/2897] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:54.819469 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16bcd8-700b-4116-9e66-185a9cab74aa None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:54.819758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16bcd8-700b-4116-9e66-185a9cab74aa None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:54.820038 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16bcd8-700b-4116-9e66-185a9cab74aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:54.838876 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-2a16bcd8-700b-4116-9e66-185a9cab74aa None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:54.840083 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-2a16bcd8-700b-4116-9e66-185a9cab74aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:54.848326 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1444/2898] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:26:54.852396 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9fc10-26ce-4990-9d80-1813c1c2e5cf None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:54.862613 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9fc10-26ce-4990-9d80-1813c1c2e5cf None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:54.867145 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d483274-de25-40e0-9ee8-789a591b29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:54.867790 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d483274-de25-40e0-9ee8-789a591b29a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:54.868070 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d483274-de25-40e0-9ee8-789a591b29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:54.868344 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d483274-de25-40e0-9ee8-789a591b29a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:54.869060 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d483274-de25-40e0-9ee8-789a591b29a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80382) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 18:26:54.869362 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d483274-de25-40e0-9ee8-789a591b29a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:54.870972 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d483274-de25-40e0-9ee8-789a591b29a7 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:54.883300 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1455/2899] 10.222.0.30 () {58 vars in 1152 bytes} [Mon May 23 18:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 18:26:54.887844 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16bcd8-700b-4116-9e66-185a9cab74aa None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:54.898847 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16bcd8-700b-4116-9e66-185a9cab74aa None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:54.905519 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb687210-be22-4601-9579-15f97d08ff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:54.906429 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb687210-be22-4601-9579-15f97d08ff15 admin admin] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:54.907149 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb687210-be22-4601-9579-15f97d08ff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:54.907645 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb687210-be22-4601-9579-15f97d08ff15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:54.908930 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb687210-be22-4601-9579-15f97d08ff15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:54.912047 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb687210-be22-4601-9579-15f97d08ff15 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:54.952250 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1445/2900] 10.222.0.30 () {60 vars in 1152 bytes} [Mon May 23 18:26:54 2022] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:26:54.956298 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d483274-de25-40e0-9ee8-789a591b29a7 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:54.966208 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d483274-de25-40e0-9ee8-789a591b29a7 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:55.021447 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c1203-ff61-49c1-a71a-c8cdc6d01be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:55.022105 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c1203-ff61-49c1-a71a-c8cdc6d01be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:55.022391 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c1203-ff61-49c1-a71a-c8cdc6d01be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:55.022669 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c1203-ff61-49c1-a71a-c8cdc6d01be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:55.023384 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c1203-ff61-49c1-a71a-c8cdc6d01be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:55.025289 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c1203-ff61-49c1-a71a-c8cdc6d01be3 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:55.044776 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1456/2901] 10.222.0.30 () {60 vars in 1143 bytes} [Mon May 23 18:26:54 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 18:26:55.049221 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb687210-be22-4601-9579-15f97d08ff15 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:55.059332 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb687210-be22-4601-9579-15f97d08ff15 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:55.064652 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec46cf-1971-40dc-a7b5-0a4974df1813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:55.065303 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec46cf-1971-40dc-a7b5-0a4974df1813 admin admin] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:55.065585 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec46cf-1971-40dc-a7b5-0a4974df1813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:55.065861 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec46cf-1971-40dc-a7b5-0a4974df1813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:55.066577 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec46cf-1971-40dc-a7b5-0a4974df1813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:55.068205 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec46cf-1971-40dc-a7b5-0a4974df1813 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:55.078035 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1446/2902] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 18:26:55.081967 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c1203-ff61-49c1-a71a-c8cdc6d01be3 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:55.091720 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c1203-ff61-49c1-a71a-c8cdc6d01be3 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:55.096432 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0756e-881b-462a-a191-7fcd406a1813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:55.097086 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0756e-881b-462a-a191-7fcd406a1813 admin admin] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:55.097369 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0756e-881b-462a-a191-7fcd406a1813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:55.097645 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0756e-881b-462a-a191-7fcd406a1813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:55.098375 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0756e-881b-462a-a191-7fcd406a1813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:55.100041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0756e-881b-462a-a191-7fcd406a1813 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:55.110249 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1457/2903] 10.222.0.30 () {58 vars in 1121 bytes} [Mon May 23 18:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 18:26:55.114198 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec46cf-1971-40dc-a7b5-0a4974df1813 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:55.124693 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec46cf-1971-40dc-a7b5-0a4974df1813 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:55.129282 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30fb2e-c2a4-49c1-85b6-973db274e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:55.130145 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30fb2e-c2a4-49c1-85b6-973db274e619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:55.130430 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30fb2e-c2a4-49c1-85b6-973db274e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:55.130731 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30fb2e-c2a4-49c1-85b6-973db274e619 admin admin] PATH_INFO: `/v3/projects/3bc87618a4f84131bc83b1fe31187dfb/users/83ebde7e7e3d47c785878088ac8732f8/roles/bce93d0b549349079c3292eb120d54c1` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:55.145641 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30fb2e-c2a4-49c1-85b6-973db274e619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc87618a4f84131bc83b1fe31187dfb, user_id=83ebde7e7e3d47c785878088ac8732f8, role_id=bce93d0b549349079c3292eb120d54c1)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:55.148297 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30fb2e-c2a4-49c1-85b6-973db274e619 admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:55.160740 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1447/2904] 10.222.0.30 () {60 vars in 1482 bytes} [Mon May 23 18:26:55 2022] PUT /identity/v3/projects/3bc87618a4f84131bc83b1fe31187dfb/users/83ebde7e7e3d47c785878088ac8732f8/roles/bce93d0b549349079c3292eb120d54c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:26:55.173360 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d28f-5042-4113-93ae-1fa83532d700 None None] REQUEST_METHOD: `POST` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:55.173653 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d28f-5042-4113-93ae-1fa83532d700 None None] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:55.173924 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d28f-5042-4113-93ae-1fa83532d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:55.200927 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.auth.core [None req-dc77d28f-5042-4113-93ae-1fa83532d700 None None] MFA Rules not processed for user `83ebde7e7e3d47c785878088ac8732f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80382) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:26:55.202757 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-dc77d28f-5042-4113-93ae-1fa83532d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:55.282288 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1458/2905] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:26:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 18:26:55.293378 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30fb2e-c2a4-49c1-85b6-973db274e619 admin admin] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:26:55.295076 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-fc30fb2e-c2a4-49c1-85b6-973db274e619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:26:55.309091 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:26:55.354986 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30fb2e-c2a4-49c1-85b6-973db274e619 admin admin] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:26:55.358680 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ac6c4-1be9-4623-b811-6e343a773f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8eae73572d54dcaac9f3f6bb24df316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:26:55.359345 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac6c4-1be9-4623-b811-6e343a773f8e service cinder] REQUEST_METHOD: `GET` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:26:55.359625 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac6c4-1be9-4623-b811-6e343a773f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:26:55.359896 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac6c4-1be9-4623-b811-6e343a773f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:26:55.368382 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ac6c4-1be9-4623-b811-6e343a773f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:26:55.369875 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ac6c4-1be9-4623-b811-6e343a773f8e service cinder] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:26:55.379199 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1448/2906] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:26:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:27:03.410667 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77d28f-5042-4113-93ae-1fa83532d700 None None] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:27:03.430176 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:27:03.476222 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77d28f-5042-4113-93ae-1fa83532d700 None None] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:27:03.480770 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:27:03.481582 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:27:03.481865 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:27:03.482138 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] PATH_INFO: `/v3/users/83ebde7e7e3d47c785878088ac8732f8` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:27:03.483333 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ebde7e7e3d47c785878088ac8732f8)` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:27:03.485276 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:27:03.531833 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ebde7e7e3d47c785878088ac8732f8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:27:03.532602 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ebde7e7e3d47c785878088ac8732f8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:27:03.548419 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ebde7e7e3d47c785878088ac8732f8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:27:03.549092 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ebde7e7e3d47c785878088ac8732f8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:27:03.564164 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.notifications [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ebde7e7e3d47c785878088ac8732f8'} {{(pid=80382) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:27:03.578059 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1459/2907] 10.222.0.30 () {58 vars in 1223 bytes} [Mon May 23 18:27:03 2022] DELETE /identity/v3/users/83ebde7e7e3d47c785878088ac8732f8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:27:03.583252 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336826-bff6-4c75-99b4-3f70628340e1 None None] REQUEST_METHOD: `POST` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:27:03.583758 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336826-bff6-4c75-99b4-3f70628340e1 None None] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:27:03.583969 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336826-bff6-4c75-99b4-3f70628340e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:27:03.601002 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.auth.core [None req-ed336826-bff6-4c75-99b4-3f70628340e1 None None] MFA Rules not processed for user `1f5dea6992a4447085d8377492272c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 18:27:03.602206 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ed336826-bff6-4c75-99b4-3f70628340e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:27:03.660957 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1449/2908] 10.222.0.30 () {58 vars in 957 bytes} [Mon May 23 18:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 18:27:03.670373 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:27:03.671788 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:27:03.728634 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d17156-8b27-4d30-bb95-820f50651924 admin admin] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:27:03.732274 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edd91c-8191-4484-a78b-6d6a00d4e2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a26055489c284bcf8f0d418e4afffe73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:27:03.732848 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edd91c-8191-4484-a78b-6d6a00d4e2be service neutron] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:27:03.733129 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edd91c-8191-4484-a78b-6d6a00d4e2be service neutron] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:27:03.733399 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edd91c-8191-4484-a78b-6d6a00d4e2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:27:03.742426 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edd91c-8191-4484-a78b-6d6a00d4e2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:27:03.743910 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edd91c-8191-4484-a78b-6d6a00d4e2be service neutron] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:27:03.754030 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1460/2909] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:27:04.022845 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed336826-bff6-4c75-99b4-3f70628340e1 None None] Authenticating user token {{(pid=80381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:27:04.024615 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.fernet_utils [None req-ed336826-bff6-4c75-99b4-3f70628340e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:27:04.041964 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed336826-bff6-4c75-99b4-3f70628340e1 None None] Validating token access rules against request {{(pid=80381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:27:04.046609 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f5dea6992a4447085d8377492272c61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883a3e766acb4bf0a201fc243774389f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:27:04.047583 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:27:04.048043 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] SCRIPT_NAME: `/identity` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:27:04.048330 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] PATH_INFO: `/v3/projects/3bc87618a4f84131bc83b1fe31187dfb` {{(pid=80381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:27:04.049621 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc87618a4f84131bc83b1fe31187dfb)` {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:27:04.051561 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] RBAC: Authorization granted {{(pid=80381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:27:04.098147 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc87618a4f84131bc83b1fe31187dfb', 'request_id': 'req-5cbff722-9a03-46a3-93f8-5cc5f09c789e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:27:04.105225 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc87618a4f84131bc83b1fe31187dfb', 'request_id': 'req-5cbff722-9a03-46a3-93f8-5cc5f09c789e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:27:04.111804 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc87618a4f84131bc83b1fe31187dfb', 'request_id': 'req-5cbff722-9a03-46a3-93f8-5cc5f09c789e'} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:27:04.121976 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] The token cache is being invalidate because project 3bc87618a4f84131bc83b1fe31187dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 18:27:04.122261 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:27:04.122912 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG keystone.notifications [None req-5cbff722-9a03-46a3-93f8-5cc5f09c789e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 18:27:04.124441 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: [pid: 80381|app: 0|req: 1450/2910] 10.222.0.30 () {58 vars in 1232 bytes} [Mon May 23 18:27:04 2022] DELETE /identity/v3/projects/3bc87618a4f84131bc83b1fe31187dfb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 18:27:13.749205 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:27:14.118992 dv-cinder-750782-23-iscsi devstack@keystone.service[80381]: DEBUG dbcounter [-] [80381] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 18:31:06.993859 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edd91c-8191-4484-a78b-6d6a00d4e2be service neutron] Authenticating user token {{(pid=80382) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 18:31:06.995271 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-c5edd91c-8191-4484-a78b-6d6a00d4e2be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:31:07.131799 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edd91c-8191-4484-a78b-6d6a00d4e2be service neutron] Validating token access rules against request {{(pid=80382) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 18:31:07.192242 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f8f85-15b0-4261-b39b-71e4430da394 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e042a473204d358e3b0682bf1338d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6640de800f74494888cbb47aa590456c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80382) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 18:31:07.192887 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f8f85-15b0-4261-b39b-71e4430da394 service placement] REQUEST_METHOD: `GET` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 18:31:07.193168 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f8f85-15b0-4261-b39b-71e4430da394 service placement] SCRIPT_NAME: `/identity` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 18:31:07.193442 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f8f85-15b0-4261-b39b-71e4430da394 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80382) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 18:31:07.195229 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.fernet_utils [None req-536f8f85-15b0-4261-b39b-71e4430da394 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80382) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 18:31:07.208828 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f8f85-15b0-4261-b39b-71e4430da394 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 18:31:07.210487 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f8f85-15b0-4261-b39b-71e4430da394 service placement] RBAC: Authorization granted {{(pid=80382) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 18:31:07.221041 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: [pid: 80382|app: 0|req: 1461/2911] 10.222.0.30 () {60 vars in 1365 bytes} [Mon May 23 18:31:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 18:31:17.216804 dv-cinder-750782-23-iscsi devstack@keystone.service[80382]: DEBUG dbcounter [-] [80382] Writing DB stats keystone:SELECT=89 {{(pid=80382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}